|
|
## Documenting the know 'quirks' of the json importer
|
|
|
|
|
|
- the json importer is loosely based upon the API CSV importer by Eileen
|
|
|
- Andrei used it for inspiration and I think for some API code snippets
|
|
|
- This importer allows multiple entities to be imported at once
|
|
|
- This allows multiple contacts, relationships, activities to be linked
|
|
|
- Contcats can come in with multiple addresees, emails etc and be linked back to a contact that was imported in a previous step
|
|
|
|
|
|
|
|
|
### Performance
|
|
|
|
|
|
- the goal was not to make it fast, the goal was to make it flexible and handle large data sets
|
|
|
- Currently every exception is logged to the DB. Hard Errors block the import, skipped means that data could not be imported (Warning), Mandatory Key errors mean that there was not enough data to create the entity(Info)
|
|
|
![image](uploads/b9352938f8d881db2e02d7a3cb670815/image.png)
|
|
|
- This can cause issues - if we have an import with tons of blank data the log will grow. This can cause the mysql server to slow down or crash
|
|
|
- TODO: Move exceptions to a log file and only log errors and warnings to the DB
|
|
|
|
|
|
### Data notes
|
|
|
|
|
|
- States must be State Name "New York", "NY" will not work
|
|
|
- Blank data should be avoided
|
|
|
- Custom fields with multi-select need the values "1,4,6,9" will work wheas the labels "baseball, softball, soccer, field hockey" will fail
|
|
|
- Dedupe rules need to be set for UPDATE You must choose all key fields to match on and choose the rule
|
|
|
![image](uploads/f38e0e616ae6e76fdf2ac30b53307c57/image.png)
|
|
|
- All matching and dedupe fields must be in the data set
|
|
|
- Contact Type must always be mapped fro Contact entity
|
|
|
- Location type must be set for all phones, emails, addresses
|
|
|
- Phone Type, Address Type must be set for those entities
|
|
|
- You can set the values to fields to a constant (such as Individual for Contact Type) it need not be in the csv. It only must be in the csv if some rows differ
|
|
|
|
|
|
_KJC 2022-01-25_ |
|
|
\ No newline at end of file |