3 Commits

Author	SHA1	Message	Date
Paul Lindner	d411ab86dc	Adjust allowed bot list to allow for link previews in WhatsApp and Signal (#1401) ... See signalapp/Signal-Android#10060 for how Signal uses their UA Fixes #1392	2021-09-13 17:14:30 -07:00
Gabe Kangas	c741797472	Force Applebot to be seen as a scraping bot. Closes #134	2020-08-31 20:36:52 -07:00
Gabe Kangas	ab21706d73	Add our own botlist for user-agent matching. Closes #51	2020-07-13 19:07:30 -07:00