Derek Rose · Automatic Imports

What was built

Automatic Imports is Derek Rose's largest and most complex project: a sophisticated multi-scenario inventory import system that processes product catalog data from upstream sources and syncs it into Pipedrive as deals and custom objects. The system uses a queue-based architecture to handle high-volume data processing without overwhelming the Pipedrive API, with detailed field mapping, transformation logic, and deduplication to ensure data quality.

The architecture includes multiple specialized scenarios: data ingestion and queue staging, CSV data transformation with formula-driven field mapping (handling enum values, date conversions, conditional logic), order processing with customer number matching (exact and fuzzy), and duplicate detection/resolution. The system exports processed data to CSV for verification, implements break recovery workflows, and includes comprehensive testing and validation steps before production deployment.

The project required extensive requirements gathering, multiple iterations of the core logic, and ongoing enhancements as Derek Rose's product catalog and import requirements evolved. The queue system prevents API rate limiting, the CSV export provides transparency, and the deduplication logic prevents duplicate orders from multiple import sources.

Project stats: 62 tasks, 15+ meetings with client, multiple frozen/unfrozen cycles, ~188h