Scrapy start python jobs

I am in immediate need of a Python expert who can extract data from external website and store in an MS SQL database. freelancer with extensive experience in data extraction from varied sources would be highly desirable. The skills and experience required for this job includes: - Extensive knowledge on Python-based data extraction methods - Proven experience with managing and manipulating MS SQL databases - Ability to adapt to multiple and potentially unexpected data sources - willing to work via anydesk for final installation of the project Given the urgent nature of this project, only those who can demonstrate a commitment to quick turnaround times need apply.

...am looking for a professional who can help me deploy a Python-based application to Amazon Web Services (AWS) and assist in carrying out data analysis involving statistical methods and visualization. Key requirements include: - **Cloud Deployment (AWS):** The project involves deploying a Python application to AWS. The ideal candidate should have a solid understanding of AWS services and how to efficiently utilize them for hosting and deployment. - **Data Analysis:** I need assistance with both statistical analysis and data visualization. The freelancer should have a strong background in these areas and be able to apply relevant techniques and tools to gain insights from the data. The successful candidate should be proficient in Python and have experience with cloud...

I am seeking proficient Python, C and C++ programmers with a deep understanding of Indian Equity & Derivatives Markets for unique project(s) based on our clients' requirements. Key Project Objectives: - Design, develop, and implement state-of-the-art algorithms Ideal Skills and Experience: - Proficiency in Python, C, and C++ programming languages - Strong knowledge of the Derivatives market dynamics - Previous experience in algorithm development - Ability to think innovatively and solve complex problems Let’s work together to create tailored solutions for our clients’ strategies and algorithms.

I'm looking for a skilled Python expert who can help me with a data analysis and automation project that I plan to deploy on AWS cloud. The project has two main aspects that need to be developed separately but must work in harmony once completed. Key Requirements: - Python Data Analysis: You'll be responsible for creating a Python program that can handle data analysis tasks. The program should be able to process large datasets and generate meaningful insights from them. - Automation: The second part of the project involves creating an automation system that takes the insights generated by the data analysis program and automates the generation of reports and updates data in real-time. Ideal Skills and Experience: - Proficiency in Python programming -...

...Experience: Minimum of 10 years' practical experience in cybersecurity, preferably with recognized companies. Proficiency with various cybersecurity tools and programming languages. Expertise in identifying and mitigating risks, threats, and vulnerabilities. Technical Skills: Hands-on experience with Security Information and Event Management (SIEM) tools. Proficiency in Python, Linux, and SQL. Knowledge of CIA Triad, governance, risk analysis, compliance, and business continuity planning. Familiarity with Linux and Windows server configuration, Active Directory, network architecture, operations, and security. Experience in areas such as Wireshark, email security, wireless security, cryptography, port scanning, cloud security, an...

...looking to integrate my Mitsubishi CNC M80 with MT Connect using Python. This project has two primary goals: real-time monitoring of machine status and data analysis for performance optimization. Key Requirements: - Real-time Monitoring: The system should constantly monitor the machine's status (running, idle, error) and the spindle speed. Any changes in these parameters should be promptly detected. - Error Handling: If there are any errors or the spindle speed deviates from predefined thresholds, the system should send notifications or alerts to notify me. - Spindle Speed Adjustment: It should also be capable of adjusting the spindle speed automatically based on predefined thresholds. Ideal Skills & Experience: - Proficiency in Python programming. - Experience...

We are seeking a skilled PHP/Python developer to create a web-based solution hosted on an Ubuntu server that enables users to create Indesign documents based on existing InDesign templates then download the customized document. Please place a bid only if you are familliar with Indesign API Freelancers interested in this project should ideally have experience in: - Developing web applications. - Implementing high levels of customization in a web tool. - InDesign, especially its formatting features.

I am looking for a skilled Python developer to build an application that is capable of placing trades on multiple cryptocurrency exchanges, specifically Binance, Coinbase, and Deribit. Key Features: a Python application that connects to Deribit. It should allow me to: • Pull live instrument prices o Would want to be able to pull many instruments at once – I.e. every futures expiry for all listed currencies / All option strikes across multiple expiries • Pull my positions / balances / margin usage • Place / view / amend / cancel orders o Send multiple orders at once o Cancel specific orders o Cancel all outstanding orders • Record market / Position / transaction data Latency / Speed of execution is import...

I need a Python Expert to make correction on my code. I will share the code file on chat and will discuss about the budget and time. Thanks!

There is a need for an experienced developer who can swiftly develop a feature for file uploading and image editing, with capabilities like c...developer who can swiftly develop a feature for file uploading and image editing, with capabilities like cropping. The requirements for the project include: 1. File Uploading: Capable of managing various file types, ensuring smooth upload. 2. Image Editing: Should include an editing feature, with a particular focus on cropping for image customization. Ideal skills for this would be proficiency in Python, JavaScript, HTML, and CSS, with excellent knowledge of libraries and frameworks that can facilitate image processing. This needs to be completed as soon as possible, so a freelancer who can commit and provide quick yet quality work would...

i have py code and need to make winform using qt desinger because it visual and easy+modern to do i need someone have experiance with to integrate my py code in qt (design the form) the code is fully secret for the customer, so need to apply on screen shareLIVE

...for a Python expert who can assist me in setting up real-time video streaming and data transfer from Raspberry Pi 5 to a PC over a static network configuration. The project involves an underwater camera and sensor data. Tasks include: Supply Python client and server scripts on a PC and rpi5+camera over a static IP network connection. Using the picamera2 module to stream video to PC. The video is recorded on the PC (time stamp for file name), with text overlay on the video showing PC date and time. UDP for simple 2way communications of small 'hello world' type text strings between the RPI5 and PC. Happy to control everything from the python script on the PC at present with a simple window for viewing the video. No GUI required at present. You should hav...

I'm in urgent need of a mobile backend developer with profound experience in Python Flask. Your primary task will be to integrate and create APIs on my current database structure. - The API should be able to perform: data retrieval, data modification, and user authentication among others. - Your success in this project is highly dependent on your ability to work with a moderate complexity level of database structure. - I'm looking for someone who can start on this project immediately, as the urgency for the API integrations is high. Key Skills and Experience: - Proficiency in Python Flask for backend development - Proven experience in integrating and creating APIs - Ability to work with moderate complexity databases - Strong knowledge in data retrieval, mod...

...technical and consumer needs. Qualifications: • Bachelor's degree in Computer Science, Engineering, or related field. • 3-5 years of prior relevant work experience as a Full Stack Developer or similar role. • Proficiency in front-end languages such as HTML, CSS, and JavaScript. • Experience with JavaScript frameworks such as Angular, React, or Vue.js. • Proficiency in server-side languages such as Python, Ruby, Java, PHP, or Node.js. • Experience with database technology such as MySQL, PostgreSQL, MongoDB, or similar. • Familiarity with RESTful APIs and microservices architecture. • Excellent verbal communication skills. • Good problem-solving skills. • Attention to detail. Preferred Qualifications: • Experience with...

Application code to implement Roomio as a web application in python. You will use the table definition posted at the end of this document.

I'm looking for an expert in Django to develop an Enterprise Resource Planning (ERP) system that consists of three main modules: Acutally there are some as follow but everything is in dotnet and I have to convert it into django. 1. Inventory Management 2. Sales Management 3. Human Resources Management Ideal skills for the job include experience in Django, Python, and ERP system development. The system should support 10-50 user accounts. In addition, specific reports need to be generated for each module that includes: - Sales forecast report - Inventory status report - Employee performance report A solid understanding of business operations, particularly Inventory, Sales, and HR management is highly desirable. The successful freelancer will have a keen attention t...

I'm looking for a highly experienced and strategic consultant/COO to help boost the efficiency of my start-up furniture factory. Key Responsibilities: - Advise on the best practices and strategies to increase production efficiency. - Suggest methods to enhance the overall workflow, distribution, and supply chain. - Implement improvements to streamline our operations and cost-effective solutions. Skills and Experience: - Proven track record as a COO or consultant within the furniture or manufacturing industry. - Exceptional expertise in enhancing production efficiency. - Strong analytical skills to identify bottlenecks and offer solutions. - Excellent communication and consulting abilities. Please include detailed project proposals in your application. The project needs to ...

I need a Python code that can detect and count objects on the ground. Key requirements include: - Detecting and counting objects on the ground, concept similar to crowd counting. - Providing a reliable count in, as well as evaluation. Deep learning based counting would be helpful. Ideal freelancer for this project should have: - Proficiency in Python - Experience with object detection algorithms - Knowledge of crowd-based counting systems

...completed similar tasks. I require a specialist in web scraping to extract the body text from articles on Google News. The information will be earmarked for natural language processing, hence, accuracy of extraction and correct formatting into an excel file is of utmost importance. Key responsibilities and skills: - Experience in web scraping, specifically from news websites. - Knowledge of creating Python or PHP scraping scripts or using API. - Ability to deliver results fast, as the project needs to be completed ASAP. Please note that the sole requirement is to extract the body of the news articles with no need for the title, date or author. Let me know your approach and estimated timeframe for completion and budget. I give you (English only) - Google News search keywords...

I need a python supper expert who can do this simple apps for me. simple but complex. if you are supper expert then you can easily do it. i will give you in details in chat. thanks

I need someone to convert a specific function in Python, named GetServicesAreas, to Laravel. This function should be able to retrieve service areas based on countries, with a particular focus on the United States. Ideal Skills: - Laravel - Python - JSON - REST API Specific Responsibilities: - Extracting the function GetServicesAreas from existing Python code - Converting the extracted Python function to Laravel while ensuring complete functionality - The converted function should return service areas based on country parameter - Focusing specifically on the entire United States for function output - Conducting thorough testing to verify that the function operates correctly Experience: - A background in both Python and Laravel is essential - Experi...

I am in need of a skilled Python expert to transform a raw excel report into a final template version of excel. The project requires two main tasks: Formatting and re-arranging of columns along with calculation updates for one column. Key Points; - Need 3 open reports to pull the information and split the reports at the end. - Formatting Changes: The report needs specific columns to have pre-defined blank values for certain columns: Col B, E, J, R, W, AB, AE, AJ, AV, BG, BI, BJ, BQ, BU, BV, BW, BX, BY, BZ. - Calculation Updates: The calculation layer within the excel report needs to be updated and finalized. The ideal freelancer for this project should have a profound understanding of Python and extensive experience in manipulating and formatting excel reports. I am lookin...

Fixed bugs with iCloud website. Automation press button (2bugs only)

Hello and Thank you for being here Please see below code to read USERS from Keycloak using the api task: - Need to get REALM data for each user - Need to get GROUP data for each user We can do a 2nd Milestone if you like and we can talk about that together ----------------------------------------------------------------------------------------------- WORKING CODE TO READ USERS cat from keycloak import KeycloakAdmin admin = KeycloakAdmin( server_url="serverURL:port", username='admin', password='password', realm_name="master") print("current realm",admin.get_current_realm()) users = admin.get_users({}) if len(users) > 0: print("-------------------------------------") for user in users:...

Hello and Thank you for being here Please see below code to read USERS from Keycloak using the api task: - Need to get REALM data for each user - Need to get GROUP data for each user We can do a 2nd Milestone if you like and we can talk about that together ----------------------------------------------------------------------------------------------- WORKING CODE TO READ USERS cat from keycloak import KeycloakAdmin admin = KeycloakAdmin( server_url="serverURL:port", username='admin', password='password', realm_name="master") print("current realm",admin.get_current_realm()) users = admin.get_users({}) if len(users) > 0: print("-------------------------------------") for user in users: ...

...with legal and regulatory standards applicable to blockchain and trading technologies. Develop strong security protocols to protect users' data and transactions. Testing and Deployment: Perform comprehensive testing to confirm the bot's performance and reliability. Deploy the bot on a robust server environment, ensuring high availability and performance. Required Skills: Strong proficiency in Python or JavaScript, with substantial experience in blockchain application development. Previous experience with Telegram bots and API integrations. In-depth knowledge of the Solana blockchain's workings, including its transaction processes and fee structures. Familiarity with regulatory aspects of blockchain and trading technologies. Deliverables: A fully operational Tele...

This script must be developed in Python 3 or higher and must take a PNG image as input and return 4 letters. It is desired to achieve 95 percent accuracy or higher (out of a total of 200 test images), not use paid libraries, and be efficient (less than 3 seconds processing time per image). Hardware where it will be tested: Architecture: x86_64 CPU operation mode(s): 32-bit, 64-bit CPU(s): 8 Memory: 15877 The images can be extracted from the following site (captcha image):

This script must be developed in Python 3 or higher and must take a PNG image as input and return 4 letters. It is desired to achieve 95 percent accuracy or higher (out of a total of 200 test images), not use paid libraries, and be efficient (less than 3 seconds processing time per image). Hardware where it will be tested: Architecture: x86_64 CPU operation mode(s): 32-bit, 64-bit CPU(s): 8 Memory: 15877 The images can be extracted from the following site (captcha image):

...employers. The goal is to design a site similar to but tailored to our specific needs, including custom graphics and a unique logo that represents our brand identity. KEY REQUIREMENTS Languages and Frameworks: - Frontend: Expertise in HTML5, CSS3, JavaScript, and experience with frameworks like React.js or AngularJS. - Backend: Proficiency in server-side languages such as PHP, Python, or Node.js, with database management using SQL or MongoDB. - CMS Experience: Capability to integrate and customize content management systems (CMS), preferably WordPress or Drupal. Design and Graphics: - Creation of a unique logo and custom graphics that reflect our brand and the services we offer. - Design a responsive and accessible website that adjusts smoothly to different screen sizes and

...seeking a skilled Python freelancer to assist me with a specific automation project. The task involves training video frames for bee detection. Key Tasks: - Train video frames for bee detection: I have a series of video frames that I need to analyze for bee presence. You'll be responsible for training the Python code to recognize bees within these frames efficiently. Goal: The primary objective of this automation task is to enable the Python script to accurately recognize bees within the video frames. The end goal is to achieve optimal object recognition. Ideal Candidate: - Proficient in Python programming - Experience in object recognition - Familiar with training video frames - Background in automation and data analysis If you have the necessary s...

I'm in need of a Cloud-based HPC system for a statistical analysis project. Key Requirements: If you have access to a HPC i need that service for a python code. lets talk about price

I am currently seeking a skilled developer to create an efficient bot for my new Twitter account. This bot is expected to fulfill the following functions: - Auto-follow users - Auto-like tweets - Auto-retweet tweets Moreover, these tasks should ...This bot is expected to fulfill the following functions: - Auto-follow users - Auto-like tweets - Auto-retweet tweets Moreover, these tasks should be performed every hour. The bot should be designed with a specific focus on male audience content themes. In terms of skills, the ideal candidate should have: - Demonstrable experience in bot creation - Understanding of Twitter API - Proficiency in Python, JavaScript or other relevant languages - Proven track record of creating social media bots in the past. I am looking forward to your ...

This script must be developed in Python 3 or higher and must take a PNG image as input and return 4 letters. It is desired to achieve 95 percent accuracy or higher (out of a total of 200 test images), not use paid libraries, and be efficient (less than 3 seconds processing time per image). Hardware where it will be tested: Architecture: x86_64 CPU operation mode(s): 32-bit, 64-bit CPU(s): 8 Memory: 15877 The images can be extracted from the following site (captcha image):

convert coordinates into url using webscraping python

I'm currently seeking an adept Python developer capable of crafting a bot designed to circumvent the Cloudflare protection of a specific website (details will be disclosed privately to the chosen freelancer). The bot should reliably bypass the protection consistently, as my attempts have yielded varied results, occasionally succeeding but often encountering 'Failure!' from Cloudflare. Efficiency in handling a large volume of attempts is crucial. If you possess the necessary skills and are up for the challenge, please get in touch. Ideal Candidate: - Proficient in Python, with experience in bot development - Familiar with CloudFlare's security measures and how to bypass them - Experienced in automated testing and website monitoring - Strong problem-solving...

I'm looking for a skilled developer to create Python-based modeling and simulation tools for UAV Swarms. Ideal candidates should have experience in Python and Machine Learning, as well as a solid understanding of industrial processes and systems. The tools should ideally offer real-time simulation capabilities, data visualization, and the ability to integrate with relevant software. A formal report of the project is required with the simulation and coding work. You may need to discuss these details with me once we get started on the project.

...a skilled Python developer to create an Ant Colony Optimization (ACO) algorithm that can read numbers in a matrix to calculate the shortest distance and its respective cost. Key Features: - The algorithm should respect origin and destination points, which will be indicated by specific row and column numbers. - Ideally, the code should be able to parse a .xlsx file format. Desired Skills: - Proficiency in Python programming language - Experience with optimization algorithms, particularly the Ant Colony Optimization algorithm. - Familiarity with .xlsx file parsing. I already have a basic code and can provide it to you as reference material; however, I need someone to improve and expand on this code to meet the requirements. It is essential for the proposed solution to u...

...talented developer with strong expertise in Python and options trading to create neutral trading strategies for me. The scope of this project includes: - Designing trading strategies primarily focusing on neutral approaches. It's critical that you're familiar with various trading strategies and especially skilled in applying neutral strategies. - The strategies should accurately consider option strike prices. An in-depth understanding of how option strike prices impact the trading outcome will be invaluable for the success of the project. - The complexity level required in this project involves developing multi-leg option positions. Therefore, experience and knowledge in creating such advanced strategy positions is a must. Advanced knowledge in Python, fina...

I want a python script that will check the balance of my four wallets inj1.... (injective blockchain), cosmos1.... (cosmos blockchain), osmo1.... (osmo blockchain) and juno1.... (juno blockchain) every 5 seconds. And in case the INJ balance increases, ATOM. OSMO or JUNO, then the entire balance will be transferred fully automatically to another wallet inj1...., cosmos1...., osmo1.... and juno1.....

I'm in need of an expertly developed trading bot capable of purchasing a new coin as soon a...forthwith. Specifically, the platform targeted for this task is kucoin. Key Responsibilities: * Crafting a bot proficient in immediate buying and selling of newly listed coins. * Ensuring immense reliability and speed of the bot's functionality. * Ensuring that the bot is compatible with kucoin and open to future adaptations for other platforms. Ideal Skills and Expertise: * Versatile experience in Python language. * Previous exposure to developing trading bots. * Deep awareness of kucoin and other potential exchange platforms. Ultimately, the bot should advance my trading performance by maximizing profitability through quick purchases and sales in the volatile moments when coi...

I'm seeking a skilled developer to take my ...algorithm should be optimized to better handle the extracted data. The developer should ensure that the comparison is done accurately and efficiently. - **User-Friendly Interface:** The current demo code lacks a user-friendly interface. I am looking for a developer who can design and implement a clean, intuitive and user-friendly interface. Preferred Programming Language: Python - The application is currently built in Python and I would like to stick to this language for consistency. Notable Requirements: - The application should be able to handle both Word and Excel documents. - The final product should be a fully functional web-based application. It should be able to extract data from both Word and Excel documents and com...

I'm searching for a Python developer knowledgeable in numerical data analysis. The key task of this project will be developing a Python script for classifying images. This script will then need to perform advanced data visualization tasks on numeric data. Task would be to analyze a dataset containing different types of fish breeds Images and is required to classify them using CNN based on their location and chemical compositions in various parts of an ocean/location Ideal Skills: - Excellent grasp of Python programming - Strong understanding of image classification techniques - Proficiency in numerical data analysis - Expertise in data visualization methodologies Previous experience with projects involving Python, image classification and data visual...

I'm seeking a professional in Python with experience in computer vision, specifically with DVS 346 cameras. The goal of the project is to: - Detect human movements: Standing, walking, sitting, waving, jumping, running - Calculate the speed of detected movements The project will take place in an indoor environment. Ideal candidates should have: - Proficiency in Python - Expertise in computer vision - Experience with DVS 346 cameras would be a plus This is a unique project that requires attention to detail and an understanding of both human movement and computer vision principles. The ideal freelancer will be able to deliver accurate movement detection and speed calculations. I already have the DVS 346 camera for this project.

Hello and Thank you for being here Please note I need to install python 3.10 on centos and do not have a C compiler there Is there a solid set of steps without a C compiler ? Will give a 5 Star Review when this is done and will write such inspiring words for you, when done. Please understand; there is hope you can give your “best” price; been unemployed, and have cancer with bills backing up, $10 possible? Please note $10 is the max total that I can handle for this (doing hourly reduces % fee). Will leave a Glowing paragraph of feedback 5 stars : - ) My funds are low but will pay quick and leave 5 stars. Please give your best possible for your bid ? (something reasonable?) Please note there is hope we can mutually complete this task; we can leave each other nic...

Python refactor code, change logic for the investment strategy

I'm seeking a freelance Python developer to improve the performance of a perspective correction script which is currently struggling with shapes that have more than 4 points. I have a Python script that does perspective correction of the images. It works in cases where the shape has 4 corners. If a shape has more than 4 corners, the script will not work. Please see attached and The script obviously fails on the "L" shapes. The has the expected result simulated. Attached is a zipped folder with everything you need to start. To run a script, use this command {filename} Example The "source" folder has various source images that have working and non-working cases. I need a solution that

I'm seeking an experienced Python developer who can leverage PyG to improve the accuracy of existing link prediction models on co-authorship network data. Key Responsibilities and Requirements: - Enhance existing models: You'll be tasked with optimizing and fine-tuning our current link prediction models, in order to improve the accuracy of the predictions. - PyG Proficiency: Proficiency in PyG, a Python-based library for building graph neural networks is a must for this project. - Previous experience: Experience with machine learning, particularly in the field of link prediction, would be ideal. - Dataset knowledge: Familiarity with handling co-authorship network data is a plus. I'm looking for a proactive, detail-oriented individual who can work independen...

I'm looking for a highly skilled data scientist to dive into a project that requires a strategic blend of data analysis, data modeling, and machine learning. Python proficiency is essential for this role, as it's the primary tool we will be using. Ideal Skills: - Python programming - Data analysis - Data modeling - Machine learning Despite the specifics of the dataset size and type being unclear, the candidate should have experience handling different scales and types of datasets. Your ability to adapt and work with varying datasets will be essential. Please be prepared to showcase similar past projects in your proposal.

I am seeking a skilled developer who has strong expertise in Java or Python programming languages. This project involves developing a robust software that includes several key features: - User Authentication: Your capabilities should include creating a secure log-in feature for the users. - Database Integration: The software will need to interact smoothly with an existing database, so experience with database systems is essential. - Reporting and Analytics: The ability to incorporate reporting and analytics functionalities into the software is crucial. - Facturation: Knowledge of finance or billing systems is required to integrate facturation, it's a key component of this project. - Calendar: Lastly, being able to integrate a user-friendly calendar will be an added advantage. ...

I'm utilizing an eform generator that necessitates manual setup of form fields and checkboxes on a PDF. To streamline this task, I'm looking for an expert who can automate the conversion of PDFs or image files into HTML, using the image/PDF as a background. If...g-your-own-eforms/ Key Requirements: - Automation: The primary goal of this project is to automate part or all of the the form creation process - even if there is a way to automate the location of top left pixel of each checkbox. - Simplicity: The forms that need automating are relatively straightforward, including basic types such as text and checkboxes. Ideal Skills: - Proficiency in HTML, Python - Ai/Machine learning - Previous work in automating form creation is a plus. Please, feel free to reach out for fu...