Logo of Huzzle

Data Engineer

image

Intapp

3d ago

  • Job
    Full-time
    Junior, Mid & Senior Level
  • Software Engineering
  • Berlin
  • Quick Apply

AI generated summary

  • You need strong Python skills, experience with web scrapers (Scrapy, Beautiful Soup), knowledge of distributed programming, familiarity with data storage (SQL, NoSQL), and good problem-solving abilities.
  • You will develop and maintain web scraping tools, design data pipelines, ensure data quality, collaborate on data needs, and analyze data for insights while adhering to best practices and regulations.

Requirements

  • Strong programming skills in Python.
  • Experience in building and deploying web scrapers using tools like Scrapy, Beautiful Soup, XPath, etc.
  • Knowledge of parallel and distributed programming including load balancing, scalability, and concurrency
  • Familiarity with data storage technologies like databases (SQL, NoSQL) and data formats (JSON, CSV, etc.)
  • Problem-solving skills and attention to detail, ensuring accuracy and quality in scraped data.
  • Strong communication skills to effectively convey findings and collaborate with team members.

Responsibilities

  • Develop, deploy, and maintain web scraping tools to gather data from targeted websites efficiently and reliably.
  • Design and implement data scraping architectures that are scalable and robust.
  • Design, develop, and maintain scalable and efficient data pipelines to ingest and process large volumes of data from diverse sources.
  • Build and optimize data loaders to ensure seamless data integration and transformation.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
  • Implement and maintain data quality checks to ensure the accuracy and consistency of data.
  • Perform exploratory data analysis to identify trends, patterns, and insights.
  • Stay up-to-date with industry best practices in web scraping, data analytics, and data privacy regulations.

FAQs

What is the primary role of a Data Engineer at Intapp?

The primary role of a Data Engineer at Intapp is to design, build, and maintain data pipelines and data loaders, as well as to scrape data from various sources, ensuring the quality, integrity, and availability of data for data-driven decision-making.

What programming skills are required for this position?

Strong programming skills in Python are required for the Data Engineer position at Intapp.

What tools or libraries should a candidate be familiar with for web scraping?

Candidates should have experience in building and deploying web scrapers using tools like Scrapy, Beautiful Soup, and XPath.

Is there a focus on data quality in this role?

Yes, data quality checks are important in this role to ensure the accuracy and consistency of the scraped data.

What kind of data storage technologies should a candidate know?

Candidates should be familiar with data storage technologies including SQL and NoSQL databases, as well as data formats like JSON and CSV.

Will I need to collaborate with other team members?

Yes, collaboration with data scientists, analysts, and other stakeholders is crucial to understand data requirements and deliver high-quality data solutions.

Are there any preferred qualifications for this position?

Preferred qualifications include experience with data manipulation libraries (e.g., pandas, NumPy), familiarity with Azure and their data services, knowledge of data governance and security best practices, and experience with containerization and orchestration tools (e.g., Docker, Kubernetes).

What benefits does Intapp offer to its employees?

Intapp offers a competitive salary, flexible work environment, generous paid parental leave, flexible Paid Time Off, wellness programs, opportunities for personal growth and professional development, and a collaborative workspace.

How does Intapp approach equal employment opportunities?

Intapp provides equal employment opportunities to all qualified applicants and makes hiring decisions without regard to various protected characteristics, ensuring a fair and inclusive hiring process.

What precautions does Intapp take against hiring scams?

Intapp does not hire through text messages, social media, or email alone and conducts a rigorous interview process before extending job offers. They communicate only through secure company email addresses and do not ask for financial information during the application process.

Accounting
Industry
1001-5000
Employees
2000
Founded Year

Mission & Purpose

Intapp powers connected firms. Trusted by 2,250 of the world’s top private capital, investment banking, legal, accounting, and consulting firms, Intapp offers end-to-end, cloud-based connected firm management software built for the unique needs of partner-led firms. Intapp helps enhance collaboration, unleash collective knowledge, transform decision-making, and fuel success. Our products and services span the entire relationship lifecycle — from strategy through origination and execution — to drive optimal outcomes.