Data Engineer
 Spectraforce Technologies | |
 United States, Illinois, Chicago | |
 Oct 18, 2024 | |
|
Role: Data Engineer Location: Chicago, IL (Hybrid 3 days onsite in every week) Duration: 7+ Months Job Description: Experience level: 3 (7+ years) Qualifications (must haves): Knowledge of Python, Snowflake, Apache Kafka, Data warehousing, ETL tools and Agile development methodology Knowledge of full secure development life cycle Analytical and problem-solving skills A positive goal-oriented attitude with a focus on delivery. Experience working in onsite-offshore setup Skillsets: - Python framework design and development - Data ingestion using Kafka - Snowflake, SnowSQLs - Data Modelling, Design and Coding - Oracle/SQL - Unix/Linux - Shell Scripting, Git Nice to have: JAVA script and APIs Data Stage v11.3 and v11.7 Tasks & Responsibilities: - Design and Develop effective Data load solution using Python, Kafka or other data integration methodologies - Data load using Snowflake SQLs and stored procedures - Design technical solutions using the best available technologies - Design, develop and unit test components as defined above - Consult with product analysts and/or business partners on requirements and synthesize into technical requirements and designs - On the technical side, work with architects, designers and enterprise framework groups on the best solution for both business and IT - Ensure that non-functional requirements such as security, performance, maintainability, scalability, usability and reliability are being considered when architecting solutions - Ensure code meets standards and tested appropriate - Responsible for identifying and fixing any environmental issues and regularly gets pulled to resolve platform production related issues | |