Senior Software Engineer

Essential duties and Responsibilities: 

• Mandatory Skillset : Hadoop, SQL, Hive/Impala, Pyspark, Python, Unix

• Good to have: Django-python, Flask - Python, Airflow, Streaming

• Years of Experience : 4+years

• Maintain highly scalable data platform and analytical solutions including but not limited to the following technologies RDBMS / Big Data / Cloud. 

• Applies knowledge of general business functions and systems to develop IT strategies, operational plans, and standards to support achievement of department, business, and corporate goals. 

• Responsible for partnership with internal and external stakeholders to ensure high quality delivery of information technology solutions. 

• Designs and develops database by setting expectations and features priorities throughout development life cycle; determining design methodologies and tool sets; completing programming using languages and software products; designing and conducting tests. 

• Recommends system solutions by comparing advantages and disadvantages of custom development and purchase alternatives. 

• Completes applications development by coordinating requirements, schedules, and activities; contributing to team meetings; troubleshooting development and production problems across multiple environments and operating platforms. 

• Identify opportunities to fine-tune and optimize applications. 

• Hands on experience needed in Hadoop Ecosystem Cloudera CDP (Preferred), HiveSQL, Impala, Apache Spark (PySpark) for enhancement of any projects. 

• Monitoring and troubleshooting the scheduled jobs using Autosys. 

• Monitoring and troubleshooting issues with the data loads to S3, Athena databases in the Cloud.  

• Ensures daily deliverables complete in time for clients and monitors schedules that involves adjusting the priority of the jobs, usage of space, memory, and resources.  

• Automates any repeated manual process using Autosys scheduler and Unix/ Linux. 

Preferred Knowledge/ Experience:  

• Know the key concepts like procedures, functions, triggers, constraints, package, Sub Programs, PL/SQL error handling etc. 

• Performance Tuning, Data Modeling and Unix /Python Scripting. 

• Aware about code optimization techniques. 

• Hadoop Ecosystem Cloudera CDP (Preferred), HiveSQL, Impala, Apache Spark (PySpark) (Nice to have) 

• SQL / RDBMS – Relational Database Management Systems 

             1.    Relational Database Concepts 

             2.   Client / Server Concepts 

• Desired Competencies (Technical/Behavioral Competency) 

• Atleast 5 years hands on experience in Oracle PL/SQL UNIX / LINUX/ Python Scripting – Aware about Oracle installation, database creation, maintenance and performance tuning. 

• Behavioral traits such as right attitude, motivation, taking initiatives, organizational skills and effective time management. 

• Excellent written and oral communication skills. 

• Being a team player as well as ability to work independently with reliability and integrity. 

• Ability to establish and maintain productive working relationships in multi-disciplinary teams with good adaptability, flexibility, and negotiation skills.  

• 2+ years of experience in Hadoop Ecosystem Hive, Impala, Pyspark. (Cloudera – CDP Preferred). 

• 2+ years of experience in scheduling Autosys jobs. 

• Knowledge in cloud platform/ tools (S3, Athena) concepts and trends. AWS preferred. 

• Expert troubleshooting skills.