Content Crawler is an object meant to store data (similar to a DataTable) that you have scraped or periodically scraped from another system using the Content Service (Name)
This service is meant to return an Infotable whose values are mapped into the ContentCrawler DataShape
via the Field to Field Mappings and/or Field to Tag Mappings. The Index Settings is the same implementation
as a DataTable and allows you to create secondary indexes on the data you're persisting beyond
the index of the DataShape.
I hope this helps.