Just in case anyone else is interested in doing this the code that works is this.
<?php
$MySqlHostname = "localhost";
$MySqlUsername = "UserName";
$MySqlPassword = "PassWord";
$MySqlDatabase = "DataBasename";
$dblink=MYSQL_CONNECT($MySqlHostname, $MySqlUsername, $MySqlPassword) OR DIE("Unable to connect to database");
@mysql_select_db("$MySqlDatabase") or die( "Unable to select database");
mysql_query("LOAD DATA LOCAL INFILE 'path to/CSVFile.csv' REPLACE INTO TABLE `tablename` FIELDS TERMINATED BY ',' LINES TERMINATED BY '\r\n'");
?>
My issue turned out to be due to file paths though I was seeing no errors in the logs.