CSV to array but first remove row with extra fields - php

Question

I have a csv file with headers that sometimes have extra fields in a certain row. This is because there was a comma in the text field that was not escaped.
Is there a way to remove a row before converting into array?
Sample csv file:
CUST_NUMBER,PO_NUMBER,NAME,SERVICE,DATE,BOX_NUMBER,TRACK_NO,ORDER_NO,INV_NO,INV_AMOUNT
757626003,7383281,JACK SMITH,GND,20180306,1,1Z1370750453578430,2018168325,119348,70.70
757626003,7383282,GERALD SMITH, JR.,GND,20180306,1,1Z9R67670395033411,2018168326,119513,63.72
757626003,7383233,SCOTT R SMITH,GND,20180306,1,1Z1370750982624042,2018168329,119349,39.33
As you can see, row 3 has an extra field because Gilbert, JR. has a comma in the text field without being escaped which puts the JR. part of the name in the SERVICE column and knocks the GND field outside of the SERVICE column into a column without a heading.
I want to remove the entire row when the row has more fields than there are headers.
After the row is removed I will convert the remaining csv into an array with something like this.
<?
$csv = array_map("str_getcsv", file("FILE.CSV",FILE_SKIP_EMPTY_LINES));
$keys = array_shift($csv);
foreach ($csv as $i => $row) {
if(count($keys) == count($row)){
$csv[$i] = array_combine($keys, $row);
}
}
?>

Answer 1

As suggested by #Scuzzy unset the bad row
<?php
$csv = array_map("str_getcsv", file("FILE.CSV",FILE_SKIP_EMPTY_LINES));
$keys = array_shift($csv);
foreach ($csv as $i => $row) {
if(count($keys) == count($row)){
$csv[$i] = array_combine($keys, $row);
}
else unset($csv[$i]);
}
?>

Answer 2

<?php
$data=<<<DATA
NUMBER,NAME,SERVICE
7375536,Ron,GND
7369530,RANDY,GND
7383287,Gilbert, JR.,GND
7383236,SCOTT,GND
DATA;
$data = array_map('str_getcsv', explode("\n", $data));
$keys = array_shift($data);
$data = array_filter($data, function($v) {
return count($v) == 3;
});
var_export($data);
Output:
array (
0 =>
array (
0 => '7375536',
1 => 'Ron',
2 => 'GND',
),
1 =>
array (
0 => '7369530',
1 => 'RANDY',
2 => 'GND',
),
3 =>
array (
0 => '7383236',
1 => 'SCOTT',
2 => 'GND',
),
)
To use the column headings as keys:
$data = array_map(function($v) use ($keys) {
return array_combine($keys, $v);
}, $data);

Answer 3

Using array_filter allows you to remove the items you don't want by a callback. This version uses the $keys array as the test (same as you use), passing this into the callback using use...
$csv = array_map("str_getcsv", file("books.csv",FILE_SKIP_EMPTY_LINES));
$keys = array_shift($csv);
$output = array_filter($csv, function($row) use ($keys) {
return count($row) == count($keys);
});
$output = array_values($output);
print_r($output);
So each row which doesn't have the same number of columns is removed.
I've just added the array_values() call to re-index the array.
If you could generate the file with surrounding quotes, this problem wouldn't be there...
NUMBER,NAME,SERVICE
7375536,Ron,GND
7369530,RANDY,GND
7383287,"Gilbert, JR.",GND
7383236,SCOTT,GND
You could surround any text field with quotes of your choice to make sure this isn't a problem in the future.
Alternative...
$csv = array_map("str_getcsv", file("FILE.CSV",FILE_SKIP_EMPTY_LINES));
$keys = array_shift($csv);
$out = array();
foreach ($csv as $row) {
if(count($keys) == count($row)){
$out[] = array_combine($keys, $row);
}
}
Last update:
Just while I'm waiting to go out, tried the following. This tries to fix the data, so you get all the rows out of the file...
$out = array();
foreach ($csv as $row) {
if(count($keys) != count($row)){
$row = array_merge(array_slice($row, 0, 2),
[implode(",", array_slice($row, 2, count($row)-9))],
array_slice($row, count($row)-7));
}
$out[] = array_combine($keys, $row);
}