But if it's not in table (the first table), that query won't return any results.
Having thousands of rows shouldn't be too bad. We regularly query tables with millions of records and get results very quickly.
Make sure each table is indexed properly.
Also, do you absolutely need to have 5 tables?