Sims

Hm, I would think users could get good value out grouping search subject and selecting the best engines for their need, and receive a good spread of results from a single search.

…also, our upcoming swarm of personal AI’s might benefit from such a selfhosted search service.

Not sure what the difference is to an Android ‘tv stick’, but tv sticks cost around 20$ (converted in head from danish kr) on aliexpress. Example: https://www.aliexpress.com/item/1005006381266184.html?spm=a2g0o.productlist.main.39.ce819Szc9Szcrc&algo_pvid=78295de8-770e-47db-af24-96fd92ab26e2&algo_exp_id=78295de8-770e-47db-af24-96fd92ab26e2-19&pdp_npi=4%40dis!DKK!359.58!125.85!!!52.80!18.48!%402103252e17052172444052693eb007!12000036967194627!sea!DK!123519862!&curPageLogUid=dTrPgOd3FrQu&utparam-url=scene%3Asearch|query_from%3A

I wonder how many peeps blocked you before they reached line 3… :-)

If low on hw then look into petals or the kobold horde frameworks. Both share models in a p2p fashion afaik.

Petals at least, lets you create private networks, so you could host some of a model on your 24/7 server, some on your laptop CPU and the rest on your laptop GPU - as an example.

Haven’t tried tho, so good luck ;)