contact@kjinfo.biz   |   50 Harrison St, PH 540, Hoboken, NJ – 07030
 Facebook  Twitter  LinkedIn





Job Title: Data Engineer
Location: Travel required to unanticipated client locations throughout the U.S.

Job Description:
  1. Experience Required:     5 years
  2. Education Required:       Bachelor’s degree

Job Duties:                         

    1. Design data pipeline architecture using AZURE Databricks, SQL, PYTHON, and PYSPARK.
    2. Data Modelling and source system analysis for both structured & unstructured data.
    3. Create ML Models to predict the future trends of a definite time frame.
    4. Build algorithms and prototypes.
    5. Debug Cluster & Job logs to locate & fix the errors.
    6. Optimizing the program/code to process Gigabytes of data within a fraction of minutes.
    7. Modifying the AZURE Cluster configurations and repartition the data as per requirement.
    8. Follow the SLDC methodologies for requirement, analysis, design, development, and testing.
    9. Design data quality framework using PYSPARK and PYTHON.
    10. Support continuing increases in data volume and complexity.
    11. Develop analytical tools using Databricks SQL Queries and PYSPARK in PALANTIR.
    12. Creating multiple dashboards/visualizations depicting trends of KPIs.
    13. Interpret trends and patterns of dynamic & complex datasets.
    14. Program web based Interactive UI for end customers, consuming the data with a single API.
    15. Create & update documentation to maintain the requirements of the project.
    16. Documents include detailed specifications, implementation guides, architecture diagrams.
    17. Understand Business problem statements and help Business take financial decisions for future months based on the prediction and analysis made on the available data.
    18. Assists our client envision, contributing significantly and single handedly to multiple phases of solution.
    19. Create interactive dynamic dashboards using Palantir & Databricks SQL, depicting, multiple monitoring metrics and daily monthly future forecasts for telecom business used by Finance & Marketing dept for decision making on Budget.
    20. Create an automation for Cleaning, Merging, Visualizing & Transforming datasets from multiple data sources using Azure Databrick and created an application using Python and H2O, which helped give an overview on the scope of Tax saving.

 

Please mail resumes to:

 

KJ Info, LLC

Human Resources

50 Harrison St.

PH 540

Hoboken, NJ 07030