Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I have a question. How do you get the catalogue of books? Have you had to scrape a whole bunch of book stores, or do you make a ton of api calls? Do you store all the catalogues on your server, or are you calling a search on each of these sites live?


It's both scraping book stores and calling APIs, I do not currently index anything and do all searches live. I'm working on building in caching and eventually indexing to make everything more efficient, but since the async live searches take roughly 4-7 seconds it's not too bad at the moment.


Interesting, thanks. I do wonder how much space it would take to cache every bookstore.


I'll let you know in a few weeks




Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: