Data Loads Guide

There are a few different options for getting your data into One Model, including APIs, SFTP or a flat file. Watch this video series to learn more about data processing in One Model.

Files uploaded to One Model are tracked on the Data Loads page. To access the Data Loads page, click on Data in the main navigation bar, then select Loads

Data loads include, but are not limited to; 

  • APIs: 
    • Workday
    • SuccessFactors
    • Greenhouse
    • Oracle
    • Degreed
    • SmartRecruiters
    • …and more…!
  • Redshift: 
    • Automation files 
    • Mapping files 
    • Recruiting Data (Additional) 
  • SFTP: 
    • Survey files 
    • Custom Reports
    • Data from on-premise systems, e.g. SAP HCM
    • Anything really
  • Manual uploads:

Each data load will have a series of messages indicating the status of the load listed on the Data Loads page. The upload status, completion or error, processing, and cache status are all highlighted through a variety of these status messages. The data upload steps and accompanying status messages are explained in detail in the following table;

Data Loads Explained:

mceclip2.png

How to read the Data Loads page 

What follows is an example of what you might expect to see when reviewing the Data Loads page. The illustrated file sources are for example purposes only (and will not match your source data), but the status meanings are consistent with the table above. 

 

Selecting each data load widget or clicking on the will load a series of Messages outlining each event in the data load process. 

  • These contain alerts for each change in event the load goes through while being uploaded, validated, processed, and cached to the site. 
  • Most recent events are located at the top of each list of events
  • To load older event messages, select the Load More button located to the right of the Messages header. 

Uploaded files from each load will be sorted under the File Status Summary column located to the left 

  • To view the full list of files, select the Files dropdown
  • Files that are successfully loaded will enter the waiting status
  • Files that have errors will be sorted separately and labeled as such 

Each data load details;

  • The source file
  • The number of records in that load
  • Valid or Invalid
  • The date and time its upload was initiated
  • A short summary of the action, which includes the source (API, Redshift, etc.) that the file was uploaded from. 

Click on the file name to reveal details;

Missing a file?

If an expected file is missing from a Data Load, we recommend reviewing the transfer logs for that system to check for loading errors or to see if the file was sent from there as expected.  

Uploading the same file 

You can upload the same file twice, subject to errors, as any full files will completely replace the old data with data in the new file.  

Incremental files are set up with key columns so that if data comes through with values in the key columns that already exist in the dataset, it replaces the old record with the new - as if it's an update. When reloading the same file, this means that it will simply replace the first file's records with the second file's records, as if it's an update, even when no change to the data has actually occurred. It won't duplicate the data in the database. 

 

Got a question? Let's see if we can answer it in our FAQs

 

Was this article helpful?

0 out of 0 found this helpful

Comments

0 comments

Please sign in to leave a comment.