Insight Data Science / Data Engineering Fellow
I'm an experienced Analytics/Data Engineer. I specialize in Python (OOP, Data packages such as Pandas, Numpy, Scikit-learn and etc), Spark and other big data tools. I'm currently a Data Engineering fellow at Insight Data Science and i took up MS in Urban Informatics (Applied Data Science) in New York University, where i studied Deep Learning under Yann LeCun and Natural Language Processing/Understanding.
● Developed Tw0rdz, a dashboard for identifying user grouping patterns in Twitch, using users specific vocabulary or slangs. ● Scraped Twitch video metadata and chatlogs json files, ingested with Kafka and stored as Parquet in S3-Delta Lake.
● Led the automation project of the analytics and operations team processes using Powershell and VBS, reducing turnaround time by 80%, team headcount requirements by 2 - 3 members and cost reductions by atleast PHP 2 million.
● Led consulting teams with 2 – 4 technical consultants on server migrations and an analytics system enhancement project, collaborated with client teams on project delivery, requirements and scope and provided technical implementation strategy.