[go: up one dir, main page]

Skip to content
View tonywangcn's full-sized avatar
🎯
Focusing
🎯
Focusing

Block or report tonywangcn

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
tonywangcn/README.md

Hi there 👋

With a strong educational foundation in Software Engineering, including a Master's degree from IIT, and a professional journey spanning over 6 years, I specialize in backend development, with proficiency in Golang, Python, and TypeScript/JavaScript. I have a deep understanding of cloud infrastructure management, having worked with Aliyun and AWS, leveraging services such as Lambda, EKS, ECS, ECR, EC2, SSM, Route 53, and ElasticCache.

Beyond my formal qualifications, I'm an enthusiastic server enthusiast who maintains a personal Kubernetes cluster that stretches across various cloud providers and local servers. This not only keeps my technical skills sharp but also reflects my unwavering commitment to continuous learning and innovation.

I'm not just a technologist; I'm also a contributor to the tech community. I share my knowledge and insights through technical articles on Medium, accessible at Medium Profile. This is my way of fostering a sense of community and demonstrating my genuine passion for technology.

Golang  Python  TypeScript  Django  React  React  HTML  JavaScript  MySQL  MongoDB  PostgreSQL  Redis  Docker  Kubernetes  K3s  Hugo  NodeJS  AWS  Linux 

🔥 My Stats :

GitHub Streak


✍️ Blog Posts :

2017-02-28 How to build a scaleable crawler to crawl million pages with a single machine in just 2 hours

2023-06-12 A Step-by-Step Guide to Building a Scalable Distributed Crawler for Scraping Millions of Top TikTok Profiles

2023-08-01 How to efficiently scrape millions of Google Businesses on a large scale using a distributed crawler

2023-10-13 The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawler. Part 1

2023-10-14 Web Crawling at Scale: Navigating Billions of URLs with Efficiency

2024-10-30 27.6% of the Top 10 Million Sites are Dead

2024-11-04 The Infra to handle 10M Requests in 10 Minutes for $0.0116

Uptime Status Page For Self-hosted projects

Uptime

Self-hosted Architecture

Self-hosted Architecture

Pinned Loading

  1. distributed-web-crawler distributed-web-crawler Public

    The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawler

    Go 93 9

  2. ten-million-domains ten-million-domains Public

    27.6% of the Top 10 Million Sites are Dead

    Go 75 3

  3. scaleable-crawler-with-docker-cluster scaleable-crawler-with-docker-cluster Public

    a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine

    Python 96 27

  4. docker-cluster-with-celery-and-rabbitmq docker-cluster-with-celery-and-rabbitmq Public

    Build Docker clusters with Celery and RabbitMQ in 10 minutes

    Python 76 29