I released a full fledged search engine, written from scratch, indexing only websites from New Caledonia.
I was the sole developer, using React & Next for the front-end, Python & Scrapy for the crawling pipeline, and AWS, Zeit, Scrapping Hub, Cloudinary, Algolia, for the back-end.
I also designed the website and gathered user feedbacks to iterate on a better interface.
The search engine indexed about 1 million pages, and had around 30k visitor a month, for a country of 300k people.
I was the sole developer, using React & Next for the front-end, Python & Scrapy for the crawling pipeline, and AWS, Zeit, Scrapping Hub, Cloudinary, Algolia, for the back-end.
I also designed the website and gathered user feedbacks to iterate on a better interface.
The search engine indexed about 1 million pages, and had around 30k visitor a month, for a country of 300k people.
