-
Learned a big lesson yesterday when working with big data files, as all worked so well when testing with just little test data. But that is something i can figure out - ( by create 2 tables, 1 for categories and one for its children) - the distinct query is not a good choice with so many rows. But here it comes, importing +100.000 rows takes up over 20 minutes. I try json format and csv, no changes. As NativepPHP is for a desktop app, what are the alternatives to import such files with a higher speed? PS: i am aware sqlite3.exe is standalone and i only used it to test out.
https://laracasts.com/discuss/channels/laravel/laravel-and-sqlite-dot-commands
I also made several attempts to execute a Seeder, but it appear to not find the seeder class.
Yesterday was really a stressfull day! |
Beta Was this translation helpful? Give feedback.
Replies: 3 comments
-
Ok, getting finally some answers about the .dot-commands. Still there must be a way to import a CSV file no? ( i want to believe). |
Beta Was this translation helpful? Give feedback.
-
Following seems to be fastest in my case, it took 12 minutes to insert 115.688 rows.
|
Beta Was this translation helpful? Give feedback.
-
Finally solved the big CSV IMPORT and took just less then 2 seconds for over 115.000 rows!!! OPTION 1 (requires sqlite3 already installed on the client machine)
OPTION 2 (Add the sqlite3.exe to your project build and store it somewhere suitable)
What i have not figured out yet is if Found the install procedure via: |
Beta Was this translation helpful? Give feedback.
Finally solved the big CSV IMPORT and took just less then 2 seconds for over 115.000 rows!!!
And i have even 2 solutions for WIN only for now.
First follow the steps in this stackoverflow answer to create the .sql file and have your .csv available:
https://stackoverflow.com/a/36001304/277632
OPTION 1 (requires sqlite3 already installed on the client machine)
OPTION 2 (Add the sqlite3.exe to your project build and store it somewhere suitable)