Job Description:

This is a full-time hybrid role based in Lahore, with opportunities for remote work. As a Data Engineer (Web Scraping), you will be responsible for collecting, processing, and analyzing large datasets from the web. You will work on .data transformation, database management, image processing, API integration, and Linux system administration.

Responsibilities:

• Develop and maintain web scraping solutions using JavaScript, Puppeteer.js, Node.js, and ES6+.
• Transform and manipulate data from JavaScript to SQL for database operations.
• Process and analyze large datasets collected from the web.
• Implement and manage database solutions, including SQL, MongoDB, or Elasticsearch.
• Perform image processing and API integration tasks.
• Manage Linux systems for data processing and scraping operations.
• Ensure data quality and accuracy through rigorous testing and validation.
• Stay updated with the latest trends and tools in web scraping and data engineering.

Education Required:

• Bachelor’s degree in Computer Science, Data Science, Engineering, or a related field.

Requirements:

• Proficiency in developing web scraping solutions using JavaScript, Puppeteer.js, Node.js, and ES6+.
• Experience with data transformation and manipulation from JavaScript to SQL databases.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with web scraping tools such as Scrapy, BeautifulSoup, or Selenium.
• Knowledge of databases including SQL, MongoDB, or Elasticsearch.
• Strong understanding of data structures, algorithms, and data modeling.
• Experience with Linux system administration.
• Ability to handle large datasets and ensure data integrity.