CentOS 7 +python3 web crawling 순서

1. Python3 설치

yum -y install python3

2. Selenium + bs4 + telegram 설치

pip3 install -U pip
pip3 install beautifulsoup4
pip3 install selenium
pip3 install python-telegram-bot --upgrade

3. chrome 설치

yum -y install https://dl.google.com/linux/direct/google-chrome-stable_current_x86_64.rpm

4. chromedriver 다운로드 + 위치이동 (https://sites.google.com/chromium.org/driver/)

wget https://chromedriver.storage.googleapis.com/94.0.4606.61/chromedriver_linux64.zip
unzip chromedriver_linux64.zip
cp chromedriver /usr/bin/

5. html 소스 분석 및 파싱

6. crontab 등록