Importing products from directory dump structure - php

Question

I have the following directory structure of my database dump (total of: 18,042,482 products):
/home/nataliya/dump/10xxxxx/100xxxx/1000006/
/home/nataliya/dump/10xxxxx/100xxxx/1000007/
...
Where 1000006 and 1000007 are the product's id.
Each folder contains:
description.txt (text)
details.csv (name, oldprice, price)
images.csv (url, size)
How do I import them into MySQL, using PHP, as following:
id, name, oldprice, price, description (table `products`)
product_id, url, size (table `images`)
I apologize in advance if the question is not relative to this website, and thank everyone who wish to help me.
EDIT: Just to clarify, I'm asking only for a guidance, not for a full code example. Just the proper functions of PHP, which will make it with a good performance, since I'm talking about a directory with more than 30 million files.
EDIT: Here's what I've done for now:
<?php
function ArrayCSV($file) {
$fh = fopen($file, 'r');
while (!feof($fh) ) {
$result[] = fgetcsv($fh, 1024);
}
fclose($fh);
return $result[1];
}
$products = array();
$images = array();
foreach(scandir(dirname(__FILE__) . '/dump/') as $dir_global) {
if($dir_global != '.' && $dir_global != '..' && $dir_global != '.DS_Store') {
foreach(scandir(dirname(__FILE__) . '/dump/' . $dir_global) as $dir_local) {
if($dir_local != '.' && $dir_local != '..' && $dir_local != '.DS_Store') {
foreach(scandir(dirname(__FILE__) . '/dump/' . $dir_global . '/' . $dir_local) as $id) {
if($id != '.' && $id != '..' && $id != '.DS_Store') {
$dir = dirname(__FILE__) . '/dump/' . $dir_global . '/' . $dir_local . '/' . $id;
$product = ArrayCSV($dir . '/details.csv');
$image = ArrayCSV($dir . '/images.csv');
$products[] = array(
'id' => $id,
'name' => $product[0],
'oldprice' => $product[1],
'price' => $product[2],
'description' => file_get_contents($dir . '/description.txt')
);
$images[] = array(
'product_id' => $id,
'url' => $image[0],
'size' => $image[1]
);
}
}
}
}
}
}
try {
$DBH = new PDO("mysql:host=localhost;dbname=application", 'root', '');
$DBH->exec("SET NAMES utf8");
}
catch(PDOException $e) {
//
}
foreach($products as $product) {
$STH = $DBH->prepare("INSERT INTO products (id, name, oldprice, price, description) VALUES (:id, :name, :oldprice, :price, :description)");
$STH->execute($product);
}
foreach($images as $image) {
$STH = $DBH->prepare("INSERT INTO images (product_id, url, size) VALUES (:product_id, :url, :size)");
$STH->execute($image);
}
?>

Answer 1

I would suggest familiarizing yourself with the following function scandir() , file_get_contents() and finally, all the mysqli functions of PHP as they would be the key to what you'd need to do here.
Hope this helps!