Closed

Python/Django/Flask - Data Lineage dashboard

"Please provide a High level approach on how you are going to do it with your Bid "

I have X num of data load jobs scheduled. Each job writes to a log file and jobs are interdependent i.e. they run either serial or parallel. I want a web page to show live Lineage and tracker system with following features -

should allow me to design dependency. I must be able to choose log files and decide the lineage which will show up in the report by having a "browse File" like functionality.

One log file will have one BOX denoting the load job.

Box should show the % of completion based on Log file [login to view URL] the load process completes, log file will be completed and the color of Box should turn green sating load completed 100%.

Once BOX 1 completes 100% it should start the same for other dependent job.

If the Log file shows any error, it should show in the corresponding Box.

Once entire workflow which consist X num of load job completes, it should make everything green and notify by email.

Design and UX can go to multiple round of review

must be Linux based. Log files are Hadoop/Hive logs

Must use Python/Django/flask

Skills: Data Analytics, Django, Flask, Javascript, Python

See more: create website python django, jquery python django, python django erp program, python interactive dashboard, python dashboard django, angularjs python flask, awesome python website, how to create dashboard using python, flask bootstrap dashboard, python flask dashboard template, python flask, openldap python django, groupware python django plone, google map python django, linux python django twisted, python django career, python script extract data web page, python django projekt, python/django + web data collection -- existing code --> fully functional, python django flask

About the Employer:
( 0 reviews ) chicago, United States

Project ID: #19643262

3 freelancers are bidding on average $102 for this job

alexwmsoft

100% Completion Rate and 5 Stars Hi, there. My name is Lee, and I am an experienced web developer. I read your job description, and I am interested in your project. I have 6+ years of experiences in developing More

$25 USD in 1 day
(22 Reviews)
5.8
cindcoder

Hi, there. I have read your project description carefully. I'd like to with you on this project if possible! My name is Filipp and I am a talented computer scientist with nearly 5 years of experience. I have rich More

$30 USD in 1 day
(5 Reviews)
3.1
tascoin

Hi Sir/Ma'am, =>Having expertise with Python, Selenium, Django, OpenCV, Flask =>Experience with Node.JS, APIs, MongoDB, Postgres SQL, AWS =>Experience with back-end development & custom coding =>Experience of working More

$250 USD in 7 days
(2 Reviews)
2.4