Data Import Management Engine (D.I.M.E.)

015: Data Import Management Engine (D.I.M.E.)

The absolute best way to achieve nearly perfect imports is to use D.I.M.E.  for each broker you import data. Brokers rarely change the format of their CSV files, this gives us a chance to take advantage of having YOU visually inspect the columns to decide which should be imported (see table here)  and which should be left behind because they're just 'noise'. 

Once you have created your account, click on D.I.M.E. to start the process

'


You will be reminded of the account your importing data into. Click on 'Select CSV File' and choose a file. Unlike the direct CSV import, D.I.M.E. doesn't require the file to have an account number associated with it or be located in the data_import folder; HOWEVER, you should rename the file with the account number so it can be quickly identified if you need to import it again for any reason.

After importing, D.I.M.E. will present you with a preview of columns found and the first few rows.
Notes
The first row in the CSV file must always be the header.




Choose the columns to import. In this example, we know the securities we invest in never have 'Accrued Interest', which you can double check in a spreadsheet program, so there is no reason to import it. Also, if the account number is present, don't import that either. D.I.M.E. automatically adds the account number shown in the selection window to the end of the file during import.



Once you've selected the columns, you will be presented with a final preview of what will be imported, along with the account number at the end. Click on yes to proceed or no to cancel.



Import happens immediately, however, you will need to select the account again to force a refresh. 



Now that Stocklog+ has been told explicitly which columns to import, it will prioritize using this selection for this broker's CSV file.
ALL accounts using a specific broker will use the same template when processing automatic imports.

Example:
If Trader1's account is using Broker-A and Trader2's IRA is also using Broker-A, BOTH accounts will use the import template under BROKER-A. 

You will only need to use D.I.M.E. once-per-broker, after that, D.I.M.E. auto data import will handle the files for you.

Info
REMEMBER: If you want automatic imports to work, don't forget to include the account number in the filename
Info
You can always change the columns by selecting new ones and importing a file, this will update the template for the broker
.

    • Related Articles

    • 013: Data Import (Part 1)

      Data import is one of the Stocklog+ superpowers! Brokers may provide CSV files, but no one said they had to be perfectly formatted - and most of them are not! This is why very few brokers or journal applications attempt to import multiple company CSV ...

    • 014: Data Import (Part 2)

      See Data Import (Part 1) for header details Below are header samples with a few lines of the raw (Account field was added) .csv file to give you guidance. Each header used here worked at the time of document creation. Try using the headers below as a ...

    • 001: Where to download Stocklog+

      Always download files from https://www.xenminds.com to make sure you're receiving the most up-to-date version. Once you're on the download page, choose any location to download the application. All versions are the same, the difference in file size ...

    • 008: Trade Details (Part 1)

      Using the input from the previous input from 007: Manually Adding Trades, with addition of adding 1 share, we now have three trades. Lets go over the Trading pane details: Info: Multi-use column, can be used to show different statuses of a trade. See ...

    • 007: Manually Adding Trades

      Stocklog+ by default looks at most items as your broker does: Dates are always YYYY-MM-DD format. Stocklog+ dates of 1111-11-11 are place holders; once changed to a valid date, can not be returned to 1111-11-11 Each buy or sell is considered a unique ...