Data Loads Guide

There are a few different options for getting your data into One Model, including APIs, SFTP or a flat file. Watch this video series to learn more about data processing in One Model.

Files uploaded to One Model are tracked on the Data Loads page. To access the Data Loads page, click on Data in the main navigation bar, then select Loads. 

Data loads include, but are not limited to; 

• APIs: 
  • Workday
  • SuccessFactors
  • Greenhouse
  • Oracle
  • Degreed
  • SmartRecruiters
  • …and more…!
• Redshift: 
  • Automation files 
  • Mapping files 
  • Recruiting Data (Additional) 
• SFTP: 
  • Survey files 
  • Custom Reports
  • Data from on-premise systems, e.g. SAP HCM
  • Anything really
• Manual uploads:
  • Flat files
  • Mapping files
  • Learn how to upload a flat file. 

Each data load will have a series of messages indicating the status of the load listed on the Data Loads page. The upload status, completion or error, processing, and cache status are all highlighted through a variety of these status messages. The data upload steps and accompanying status messages are explained in detail in the following table;

Data Loads Explained:

How to read the Data Loads page 

What follows is an example of what you might expect to see when reviewing the Data Loads page. The illustrated file sources are for example purposes only (and will not match your source data), but the status meanings are consistent with the table above. 

Selecting each data load widget or clicking on the will load a series of Messages outlining each event in the data load process. 

• These contain alerts for each change in event the load goes through while being uploaded, validated, processed, and cached to the site. 
• Most recent events are located at the top of each list of events
• To load older event messages, select the Load More button located to the right of the Messages header. 

Uploaded files from each load will be sorted under the File Status Summary column located to the left 

• To view the full list of files, select the Files dropdown
• Files that are successfully loaded will enter the waiting status
• Files that have errors will be sorted separately and labeled as such 

Each data load details;

• The source file
• The number of records in that load
• Valid or Invalid
• The date and time its upload was initiated
• A short summary of the action, which includes the source (API, Redshift, etc.) that the file was uploaded from. 

Click on the file name to reveal details;

Missing a file?

If an expected file is missing from a Data Load, we recommend reviewing the transfer logs for that system to check for loading errors or to see if the file was sent from there as expected.  

Uploading the same file 

You can upload the same file twice, subject to errors, as any full files will completely replace the old data with data in the new file.  

Incremental files are set up with key columns so that if data comes through with values in the key columns that already exist in the dataset, it replaces the old record with the new - as if it's an update. When reloading the same file, this means that it will simply replace the first file's records with the second file's records, as if it's an update, even when no change to the data has actually occurred. It won't duplicate the data in the database. 

Data Loads Alerts Framework

Subscribe to receive an email notification when your data loads have completed (when the metrics are updated) or when there is an error for all or selected data sources. To set up your alerts:

• • Ensure that you have the CanConfigureNotifications permission. 
  • Click on the ‘User Account’ icon at the top right of the screen and select ‘Preferences’.
  • Open the ‘Notifications’ pane, and then click ‘Add New Subscription’. 
  • Complete the form and click ‘Save’.

Once you have subscribed to receive an alert notification, an email with your data load details, similar to what is shown below, will be sent to your email address.

If you want to dig into the details, hit the 'Details' button and you will be taken to the Data Loads page in the One Model application.

If you do not receive your subscribed alerts to your inbox, be sure to check your spam / junk folder. Please note that if you proxy as another user, you will not be able to view their preferences, including the data loads alert framework settings. 

Got a question? Let's see if we can answer it in our FAQs