Multiple/same data - php

Question

I try to make condition where i delete data before insert data to prevent multiple data but it didnt work | even the data in table become empty || 'id_lokasi' is my column name in table - database
$factpelanggan4 = DB::connection('clickhouse')
->select("SELECT t.id_tahun, l.id_lokasi, stage.jml_pelanggan
from dim_tahun t
inner join stage_pelanggan stage on t.tahun = stage.years
inner join dim_lokasi l on stage.city_id = l.id_kota
WHERE (stage.country_id = l.id_negara)
ORDER BY t.id_tahun ASC , l.id_lokasi ASC, stage.jml_pelanggan ASC
");
foreach ($factpelanggan4 as $value) {
$tahun_id[] = $value['t.id_tahun'];
$lokasi_id[] = $value['l.id_lokasi'];
$jml[] = $value['stage.jml_pelanggan'];
}
DB::connection('clickhouse')->table('fakta_pelanggan')->where('id_lokasi', $lokasi_id)->delete();
//DB::connection('clickhouse')->table('fakta_pelanggan')->where('id_lokasi', Not Null)->delete();
foreach ($factpelanggan4 as $key => $value) {
$arrayInsert = array(
'id_tahun' => $tahun_id[$key],
'id_lokasi' => $lokasi_id[$key],
'jml_pelanggan' => $jml[$key],
);
DB::connection('clickhouse')->table('fakta_pelanggan')->insert($arrayInsert);
$key++;
}

Answer 1

You should avoid deleting if you're just inserting, or deleting then inserting. If something goes wrong, you'd be left with no data similar to a truncate. What you really should be doing is inserting or updating.
You can do this manually, selecting, then either inserting or updating, separately. Or you can use firstOrCreate, firstOrNew, updateOrCreate or similar approaches.
Since you're working on multiple records at once, you might try an upsert for updating/inserting multiple records at once:
https://laravel.com/docs/9.x/eloquent#upsert
$toInsertOrUpdate = [];
foreach ($factpelanggan4 as $key => $value) {
// I don't quite follow your looping logic.
// What you wrote with $key++ after each loop before
// will be completely ignored since each loop overwrites it.
// This is a factored version of what you wrote before.
// Please double check it to make sure it does what you want.
$toInsertOrUpdate[] = [
'id_tahun' => $tahun_id[$key],
'id_lokasi' => $lokasi_id[$key],
'jml_pelanggan' => $jml[$key],
];
}
// these columns together identify duplicate records.
$uniqueIdentifyingColumns = ['id_tahun','id_lokasi','jml_pelanggan'];
// when a duplicate record is found, only these columns will be updated
$columnsToUpdateOnDuplicate = ['id_tahun','id_lokasi','jml_pelanggan'];
$tbl = DB::connection('clickhouse')->table('fakta_pelanggan');
$tbl->upsert(
$toInsertOrUpdate,
$uniqueIdentifyingColumns,
$columnsToUpdateOnDuplicate
);