The primary data provider for domain sourcing is Domain Crawler.
Data Volume: The system monitors a global dataset of over 1.4 billion domains, encompassing nearly all global and country-code top-level domains (TLDs).
Because the source dataset includes over a billion records, data is filtered internally before surfacing in the platform.
Ingestion: Zeal receives the broad data feed from Domain Crawler.
Keyword Matching: The system applies specific keyword parameters configured by Product Managers or client requirements.
Surfacing: Only domains that produce a direct keyword match against the database are logged as relevant hits and surfaced to the user.
The active monitoring environment is built to track registered domains. However, the underlying database logic handles both:
Storage: The provider's dataset includes historical and candidate data for unregistered domains.
Activation Trigger: If an unregistered domain "replies" (e.g., generates a DNS response, undergoes a status change, or becomes newly registered), it is automatically ingested and activated within the Zeal system, provided it matches the set keywords.
The system utilizes two distinct search behaviors to ensure complete coverage across all domain lifecycles:
Newly Registered Domains (NRD): This specific data feed monitors domains that have just entered the registry.
General Search: General queries perform keyword matching against the entire 1.4 billion domain database. This ensures historical coverage; if a domain was registered years ago but matches the keyword criteria, the system will identify it. Older domains are not omitted.
Domain data is not static. Updates to domain metadata and WHOIS records are managed through specific sync cycles between Domain Crawler and Zeal.
Provider Refresh Cycles (Domain Crawler):
Web Content: The provider crawls the internet approximately every 7 days to update website meta-content and titles of the domain homepage.
WHOIS Data: Ownership and registration records are updated by the provider on a rolling cycle of up to 45 days.
Zeal Ingestion and Update Logic:
Tracking Changes: Zeal tracks domain data changes (such as WHOIS updates) by monitoring the last_updated_date field provided by Domain Crawler.
The 7-Day Logic Gate: To maintain system stability, Zeal processes these updates using a 7-day synchronization cycle. If a WHOIS change is flagged by the provider on day two of the cycle, the Zeal database will officially reflect that update during the next scheduled 7-day sync for that domain.
