Add TED Scraper Configuration and Cron Scheduler Implementation
- Introduced a new configuration file for the TED scraper, defining database connection settings, logging preferences, and scraping parameters. - Implemented a CronScheduler to manage scheduled tasks for TED operations, utilizing the robfig/cron library for scheduling. - Added new entities and structures for handling TED XML data, including eForms and tender-related information, enhancing the scraper's functionality. - Updated the main application to initialize the TED scraper with the new configuration and set up graceful shutdown handling. - Removed the deprecated scraping implementation to streamline the codebase and focus on the new architecture.
This commit is contained in:
@@ -0,0 +1,17 @@
|
||||
package eform
|
||||
|
||||
// =====================================================
|
||||
// REVIEW/APPEAL INFORMATION
|
||||
// =====================================================
|
||||
|
||||
// ReviewInfo represents information about review procedures
|
||||
type ReviewInfo struct {
|
||||
ReviewBody string `json:"review_body" xml:"review_body" validate:"required"`
|
||||
ReviewBodyID string `json:"review_body_id" xml:"review_body_id" validate:"required,orgIDFormat"`
|
||||
ReviewProcedure string `json:"review_procedure" xml:"review_procedure" validate:"required,max=10000"`
|
||||
ReviewDeadline string `json:"review_deadline,omitempty" xml:"review_deadline,omitempty" validate:"max=1000"`
|
||||
MediationBody string `json:"mediation_body,omitempty" xml:"mediation_body,omitempty"`
|
||||
MediationBodyID string `json:"mediation_body_id,omitempty" xml:"mediation_body_id,omitempty" validate:"omitempty,orgIDFormat"`
|
||||
ReviewInfoURL string `json:"review_info_url,omitempty" xml:"review_info_url,omitempty" validate:"omitempty,url"`
|
||||
LodgingOfAppeals string `json:"lodging_of_appeals,omitempty" xml:"lodging_of_appeals,omitempty" validate:"max=10000"`
|
||||
}
|
||||
Reference in New Issue
Block a user