Scraping System¶

Current MVP

Automated PDF download scripts for the eight target Malaysian Blue-Chip companies are implemented in Phase 1.

Overview¶

Target Sources¶

Company	Source URL	Report Types
Maybank	bursamalaysia.com	Quarterly, Annual
CIMB	bursamalaysia.com	Quarterly, Annual
TNB	bursamalaysia.com	Quarterly, Annual
Petronas	bursamalaysia.com	Annual
Maxis	bursamalaysia.com	Quarterly, Annual
Telekom Malaysia	bursamalaysia.com	Quarterly, Annual
Genting	bursamalaysia.com	Quarterly, Annual
Sunway	bursamalaysia.com	Quarterly, Annual

Technology¶

Playwright¶

Selenium (Fallback)¶

Scraping Logic¶

Detection¶

Download¶

Storage¶

Scheduling¶

Error Handling¶

Configuration¶

# Example scraper configuration structure
SCRAPER_CONFIG = {
    "targets": [...],
    "schedule": "0 8 * * *",   # Daily at 08:00
    "retry_attempts": 3,
    "output_dir": "data/raw/pdfs/",
}