How to insert a datatable with more than 100 thousand records in mysql?

Help Studio
, ,
5

@felipe.rojas
Just like Jorge is saying i would go for the load data infile option. Working with a large set like yours i wouldn’t even consider using UiPath for that.

Plan A:
import the file from the MySql server itself:

Downside of load local data infile or load data infile:

  • disabled by default.
  • restrictions on load Local data or load data
  • user restrictions (extra permissions are needed)
  • security. (most of the time this setting is disabled for remote and also from local usage). Consider talking to your cloud admins. Or check the restrictions and options on your cloud MySql.
  • file needs to be present on mysql server. (so you need to upload the file).

Advantage:

  • a lot faster then running queries one by one.
  • can be automated by running a cronjob.

Use of UiPath:

  • upload the file to mysql server. Of course that can be automated too, but that is up to you.

Plan B:
splitting your file into smaller ones, so it uses less memory of your robot. I don’t know if this will be faster or not, but it’s worth the try if Plan A is not an option.