Software Engineer

Remote - USA

Experience

2+ years

About the Company:

This organization operates at the intersection of live entertainment, data intelligence, and high-volume digital marketplaces. They specialize in transforming complex, real-time event data into actionable insights that power pricing, forecasting, and operational decisions across the ticketing ecosystem. With a fast-moving, engineering-driven culture, they build cutting-edge systems designed to handle massive data flows, dynamic market conditions, and constantly evolving digital environments.

Responsibilities:

• Design, build, and maintain resilient, fault-tolerant, and scalable web-scraping pipelines for complex and anti-scraping websites.

• Reverse engineer client-side JavaScript, network traffic patterns, and hidden/undocumented APIs to bypass bot detection, rate limiting, and authentication barriers.

• Leverage headless browser automation (Puppeteer, Playwright) and distributed scraping architectures to extract dynamic data reliably.

• Implement strong data validation, transformation, and QA routines to ensure high-quality outputs.

• Collaborate closely with Data Science, Product, and Analytics teams to deliver well-structured, analysis-ready datasets.

• Manage and optimize large-scale data storage using modern cloud technologies (AWS, GCP, Azure) and data warehouses (Snowflake, BigQuery, etc.).

• Research, prototype, and deploy new techniques to improve scraping efficiency and detection avoidance.

• Build robust error handling, logging, and alerting systems for all scraping jobs.

Qualifications:

Required

• 2+ years of software engineering experience, ideally working with web technologies or reverse engineering complex systems (exchanges, marketplaces, data providers, etc.).

• Strong understanding of HTML, CSS, JavaScript, and HTTP/S protocols.

• Demonstrated ability to think creatively and solve tough technical problems with limited documentation.

Great to Have

• Exposure to obfuscated JavaScript, undocumented APIs, headless automation tools, traffic sniffers, proxy/IP rotation, or similar.

• Familiarity with Scrapy, BeautifulSoup, Playwright, Puppeteer, or related libraries and frameworks.