Data Portal

Online portal to maintain and filter out there required datasets from the datasets that are uploaded. Complex part was creating dynamic tables and models when the files are uploaded. The models are created by getting the header of the file. And creating a new table in database with the same header. Admin has the access to rename the data sources that are uploaded into the system. Name of data source in what that appears as the Base name of the data source that is set at the time of uploading.

Moreover if the same header appears again then the new records are saved in the previous table with same header, and user is notified. Another main part of the portal was scrubbing, scrubbing is basically a process of filtering the repeating and unique records from a list. Repeating records are combined to make a singular one of the each so that there are no repeating records in tables.

Moreover it has an API integrated where the Admin/Users ( allowed only ) are able to check particular number or a list of number against that API which in return respond with the status against each number if it is DNC ( Do not call ) number or clean to be reached.

Another part of the system is exporting data. This depends on the conditions user has set for the particular export. User can enter the size of chunks he needs for the file, this means if table has 1,00,000 records and the user specifies a chunk size of 10,000 for that table export, then 10 files with a row size of 10,000 records will be generated and the downloadable links will be available for those files. Note: The user who has generated those links only he/she can view those links. Unless the signed in user is Admin or has privileges to view those file URLs.

It also has a feature of generating number series where the admin specifies the digits from where wants the system to generate numbers. The system will automatically generate a series of number from the point provided. IP restrictions part is also added to the system where the admin can add the allowed IPs to the system. After that only allowed IP will be able to interact with the system, and all other requests that are not from the list of IPs in the system will be blocked.

User Management has the functionality to create new users, assigning roles to the users, setting up the permissions, assigning permissions to the user or roles. Activity Logs are also maintained throughout the system that saves the activities of anyone who gets interacted with the system.