mysql - insert only unique data from other table - php

Question

I have 2 tables and I want to insert data from one table to another based on a condition:
table 1:
user_id,
agency_user_id,
Output from table 1:
user_id agency_user_id
330 20
330 21
239 10
... ..
239 10
239 12
239 9
table 2:
has the same plus some other columns that I don't need at the moment...
Once a user is logged in he has 2 dropdown menus, in one I am listing user_id (not the id but info based on id) and in the other agency_user_id...
So the problem is that I don't want to have 2 times:
239 10
239 10
in table 2... I want only once (unique)...
Here is the query that I used and it doesn't work as I want it:
INSERT INTO table2
(`user_id`,`agency_user_id`)
SELECT `user_id`,`agency_user_id`
FROM table2
WHERE `user_id` AND `agency_user_id` NOT IN (
SELECT `user_id`
FROM table1
);
and now when I check there are duplicate entries in table2...
I know that I am doing something wrong in that WHERE ... NOT IN part...
Any suggestions?
Thanks.
EDIT:
I tried this as well:
INSERT INTO table2
(`user_id`,`agency_user_id`)
SELECT DISTINCT `user_id`,`agency_user_id`
FROM table2
WHERE `user_id` AND `agency_user_id` NOT IN (
SELECT `user_id`
FROM table1
);
Not working...
Current output from table 2
user_id agency_user_id
330 20 => ok
330 21 => ok
239 10 => ok
239 10 => not ok
239 12 => ok
239 9 => ok
and so on...

Answer 1

You can try using a temporary table:
Like the below example:
select * from TABLE1;
+------+------+
| a | b |
+------+------+
| 1 | 2 |
| 3 | 4 |
| 1 | 2 |
| 4 | 5 |
+------+------+
As you can see
1 2
1 2
are repeated
create a temp table:
create temporary table temp1 (a text, b text, c text);
INSERT into this:
insert into temp1 select a,b,count(*) from TABLE1 group by a,b;
select * from temp1;
+------+------+------+
| a | b | c |
+------+------+------+
| 1 | 2 | 2 |
| 3 | 4 | 1 |
| 4 | 5 | 1 |
+------+------+------+
3 rows in set (0.00 sec)
Finally
insert into table2 (a ,b) select a,b from temp;
select * from table2;
+------+------+
| a | b |
+------+------+
| 1 | 2 |
| 3 | 4 |
| 4 | 5 |
+------+------+
3 rows in set (0.00 sec)
Helped me once!!!

Answer 2

I think what you're looking for is DISTINCT:
INSERT INTO table2
(`user_id`,`agency_user_id`)
SELECT DISTINCT `user_id`,`agency_user_id`
FROM table2
WHERE `user_id` NOT IN (
SELECT `user_id`
FROM table1
) AND `agency_user_id` NOT IN (
SELECT `user_id`
FROM table1
);
where I removed created_at and updated_at to avoid duplicates and fixed the NOT IN to apply to both user_id and agency_user_id.

Answer 3

You should probably try something like this:
INSERT INTO table2(`user_id`,`agency_user_id`)
SELECT DISTINCT `user_id`,`agency_user_id`
FROM table1
WHERE `user_id` + `-` + `agency_user_id` NOT IN (SELECT `user_id` + `-` + `agency_user_id` FROM table2);
This will select distinct values from Table1 that are not already in Table2.
The way that you have your insert it is pulling all user_id's from Table2 that are not in Table1. so if you ahve user_id's that are in Table2 that are not in Table1 you will get duplicates.