I am working with 300000 lakh data where I have to go to each item and find those items in other excel and filter that item and paste in other sheet. I am using linq query but is taking hours to read and search those data how can I reduce my time.
AS-IS WORKFLOW, TO-BE WORKFLOW
-
Other information about the use case
Industry categories for this use case: Information Technology and Services
Skill level required: Intermediate
UiPath Products that were used: UiPath Studio, UiPath Assistant, UiPath Document Understanding, UiPath Orchestrator
Other applications that were used: -
Other resources: -
What is the top ROI driver for this use case?: Other
If it is up to me I will use database for storing all this information. Any of them will do instead of Excel. Databases are optimized for handling large datasets and performing efficient searches and filters.
SQL Server: Ideal for large datasets, offering robust features for indexing, querying, and optimization.
Microsoft Access: Suitable for smaller-scale applications, providing user-friendly interfaces for data management.
Excel sheet have limit of around 10 lacks of rows. So your data would definitely spread beyond 3 sheets.
Very heavy and non reliable to work on excel with this much data. Excel can break or go out of memory anytime.
I would suggest non excel solution like
Database operations: If your data is stored in a database, consider performing the necessary operations directly on the database using SQL queries. Database operations are often more efficient than working with Excel for large datasets.
Alternative file formats: If possible, consider using alternative file formats such as CSV or database files (.mdb, .accdb) that may offer better performance compared to Excel for large datasets.
