PhD-Seeker 🎓

PhD Seeker is a python web scraper to search for fully funded doctorate positions, advertised on well-known academic position websites.

If nowadays you are actively seeking a PhD position to pursue your studies, you must have realized that the process of searching for relevant vacancies is not straight forward. Visiting a large number of position advertising websites and encountering irrelevant commercials are two of the most common problems.

Simply modify the keywords and you will receive a CSV/XLSX file containing the last two pages from the most popular advertisers.

Sources 📚

• www.scholarshipdb.net
• www.findaphd.com

Next Goals 🎯

• Expanding the academic position advertising source
• Adding databases of different universities
• Finding and removing overlapped positions
• Adding LinkedIn search to get informed directly from university professors
• Getting the keywords from command line instead of hard-coding the source
• Fetching pages simultaneously
• GUI support

Installation

PyPi

phdseeker is available on PyPi:

$ pip install phdseeker

Git

You can get latest stable changes from github server:

$ git clone https://github.com/Aghababaei/PhD-Seeker.git
$ cd PhD-Seeker
$ python setup.py install

Zip, Tarball

You can download the latest tarball.

*nix

Get the latest tarball & install:

$ wget -O phdseeker-master.tar.gz https://github.com/Aghababaei/PhD-Seeker/archive/master.tar.gz
$ tar xvzf phdseeker-master.tar.gz && cd PhD-Seeker-main
$ python setup.py install

Windows

Downloading Archive

Download latest zip archive.

https://github.com/Aghababaei/PhD-Seeker/archive/master.zip

Decompress it, and run the following command in root directory of PhD-Seeker

$ python setup.py install

Adding Python to Windows environmental variables

Prior to running codes, make sure that Python has been already added to environmental variables as a Path, otherwise:

1. Right-clicking This PC and going to Properties.
2. Clicking on the Advanced system settings in the menu on the left.
3. Clicking on the Environment Variables button o​n the bottom right.
4. In the System variables section, selecting the Path variable and clicking on Edit. The next screen will show all the directories that are currently a part of the PATH variable.
5. Clicking on New and entering Python’s install directory.

Requirements

phdseeker is relied on several great python packages. If you want to just run the code by calling the script, you need to install its dependencies, in advance.

pip install -r requirements.txt

Usage

phdseeker

Usage:
    phdseeker -h
    phdseeker -V
    phdseeker [-k <keywords> --maxpage=<n> --output=<filetype(s)> -v]

options:
    -h --help                       Show this screen.
    -V --version                    Show version.
    -v --verbose                    Show the found positions on the terminal.
    -k <keywords>, --keywords=<keywords>    Declare desired keywords to seek. [default: Computer Science, Machine Learning, Deep Learning]
    -o <filetype(s)>, --output=<filetype(s)>     Set the output type csv/xlsx/both [default: both]
    --maxpage=<n>                   Maximum number of pages to fetch. [default: 10]

usage example

phdseeker -k 'Computer Science, Machine Learning' --maxpage=1 -v

Searching for the Keywords 'Computer Science, Machine Learning' in up to 1 page.
=============================::[ scholarshipdb ]::==============================
                            << 706 positions found >>
================================::[ findaphd ]::================================
                             << 64 positions found >>
Page 1 has been fetched from https://www.findaphd.com!!
770 positions have been found in total.
PhD_Positions_2022-08-08[Computer Science, Machine Learning].csv saved!
PhD_Positions_2022-08-08[Computer Science, Machine Learning].xlsx saved!
Elapsed time is 3.49 seconds.
┏━━━━┳━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃    ┃ Country        ┃ Date               ┃ Title                                                 ┃
┡━━━━╇━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ 0  │ Australia      │                    │ Doctoral / Post-Doctoral Position in Computer Science │
│ 1  │ Belgium        │                    │ PhD Studentship in Computer Science                   │
│ 2  │ Canada         │ 10 days ago        │ Master’s and PhD students                             │
│ 3  │ China          │                    │ Discovery of new materials for applications on glass  │
│    │                │                    │ using Deep Machine Learning and Data Analytics        │
│ 4  │ China          │                    │ PhD in deep learning for biomedical images of the     │
│    │                │                    │ pelvic floor                                          │
│ 5  │ China          │                    │ PhD opportunities in Computer Science at Brunel       │
│    │                │                    │ University London                                     │
│ 6  │ China          │                    │ SFI Centre for Research Training in Machine Learning  │
│ 7  │ Cyprus         │                    │ SFI Centre for Research Training in Machine Learning  │
│ 8  │ Germany        │ about 17 hours ago │ PhD Position in Artificial Intelligence, Chair of     │
│    │                │                    │ Information Systems Research                          │
│ 9  │ Germany        │ 6 days ago         │ PhD Student/Research Assistant at Software Lab (SOLA) │
│ 10 │ Germany        │                    │ Machine Learning Meets Sequential Monte Carlo Methods │
│ 11 │ Israel         │ 19 days ago        │ PhD student position                                  │
│ 12 │ Norway         │ 2 months ago       │ PhD Research Fellow in Informatics - Knowledge        │
│    │                │                    │ Representation and Machine Learning                   │
│ 13 │ Norway         │ 3 months ago       │ PhD Fellow in Computer Science - Efficient            │
│    │                │                    │ distributed machine learning                          │
│ 14 │ Poland         │                    │ The Constitutive Law Establishment of Advanced High   │
│    │                │                    │ Strength Steel based on Machine Learning              │
│ 15 │ Spain          │ 4 days ago         │ CALL 41-2022-1 Researcher in the Sustainable          │
│    │                │                    │ Artificial Intelligence (SAI) research unit           │
│ 16 │ Sweden         │ about 15 hours ago │ PhD student in Computational Science and Engineering  │
│    │                │                    │ with focus on Optimization for Federated Machine      │
│    │                │                    │ Learning                                              │
│ 17 │ Switzerland    │ about 2 months ago │ PhD position in the field of Machine Learning         │
│    │                │                    │ (Graph-based High-dimensional generative models) with │
│    │                │                    │ application to Medical Data Analysis at the           │
│    │                │                    │ Department of Computer Science                        │
│ 18 │ United Kingdom │                    │ SFI Centre for Research Training in Machine Learning  │
│ 19 │ United Kingdom │                    │ Scholarship for the PhD in Medical Sciences in the    │
│    │                │                    │ fields of Neuroscience and Biomedical Engineering for │
│    │                │                    │ the PhD Research Project ‘Development of a            │
│    │                │                    │ closed-loop controller for automatic administration   │
│    │                │                    │ of anaesthetic and analgesic agents during surgery    │
│    │                │                    │ using machine learning methods’                       │
│ 20 │ United States  │ 19 days ago        │ Fully Funded PhD Positions in Artificial              │
│    │                │                    │ Intelligence, Machine Learning, Wireless              │
│    │                │                    │ Communication -- Mississippi State University         │
└────┴────────────────┴────────────────────┴───────────────────────────────────────────────────────┘
                               All 21 found positions are shown here.