Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

It's really only between Anthropic and OpenAI for many of my use cases, since I have a Zero Data Retention agreement with both. I'm not trusting random inference providers and especially not Elmo with sensitive data.


or Tinfoil [0]? They serve open models with container integrity attested by Nvidia/AMD enclaves. Every cloud provider offers this of course, but not usually in a way that can be shared between distrusting users for economical inference. It still relies on the open-source containers being secure, and there's probably hardware sidechannels and stuff, but personally (ie privacy not liability) I trust it more than a contract

[0] https://tinfoil.sh


I loaded credits into Tinfoil the other day and have had zero issues, thanks to smart folks around here and the security space recommending it.

It's now my open weight inference provider of choice, since on top of the privacy/security characteristics it's also reasonably cheap.


Their prices are extremely high compared to the competition on https://openrouter.ai/deepseek/deepseek-v4-flash-0731 fyi.

tinfoil asks more than 10x the output cost ... $1.90 per 1M tokens instead of $0.18 per 1M tokens for my favorite model (Deepseek V4 Flash 0731) on my favorite provider (DeepInfra) currently, for example.


OpenRouter does not offer private inference, so your plaintext is shared with companies you may not even know by name.

Tinfoil OTOH claims hardware attestation and confidential computing, which is a pretty strong and (in theory) verifiable promise.

You absolutely would not recommend tinfoil.sh to someone indifferent to privacy trying to save money.

It's a very different service than OpenRouter.


plenty of companies offer ZDR and are just as random as OpenAI and Anthropic in their age


Would love a few names. Many of them fail to provide good uptime for large scale jobs or don’t have batch apis at all in my research.


DigitalOcean does inference, has good uptime and offers ZDR. They are not an AI first/inference first company. They have been serving cloud products for almost 2 decades.

Batch API is a bit harder, not many models/providers support Batch. It primarily is only the Gemini/ChatGPT/Claude models that do. DigitalOcean does support a 50% discount on Batch API via them directly, not listed on OpenRouter.

[1] https://docs.digitalocean.com/products/inference/how-to/use-...


Deepinfra is US based and has ZDR FYI.

I am quite happy with them so far.


You do not have a ZDR with Anthropic.

For Mythos and even Fable they require prompt retention on their end.

edit: or more precisely if you want to access Mythos/Fable ZDR does not apply, and depending on config the exclusion can affect other models.


I don't have experience directly with Anthropic, but I wouldn't assume anything with such high confidence without knowing the persons situation. No, an individual off the street or with an LLC and 5 employees isn't going to get a special deal from someone like Anthropic.

But if their employer is bringing millions of dollars of potential spend to the table, can tell you from years of experience that turns a lot of 'no's' to 'yes'.


The three letter agencies have and will continue make sure all of those "yes's" become "no's" again, which is why the person you're trying to claim is wrong is right and you are wrong.

You do not have ZDR with fable/mythos, nor will you ever have it again. The bedrock customers who thought they had ZDR learned rather rudely that this was not the case after the government decision that also banned non US citizens from using these models.


I use Notion Enterprise specifically for its Zero Data Retention (ZDR) access. Fable does not offer ZDR, so Notion provides a dedicated settings toggle that disables Fable outright.


I work for a large enterprise and fable/mythos are specifically banned because of the difference in data retention agreements from those models to other Anthropic models.


[dead]


There's a huge jump between OpenAI, Anthropic, Google, and every other major player distilling the internet into LLMs and deliberately breaking a mutually signed contract between them and another business.

As for ZDR and court-orders, what would you rather happen there? Violate the law or comply with holding the data? I would bet that any ZDR agreement has this court-ordered risk mutually understood and agreed upon.


I see no huge jump at all. If the companies don't care about copyright law, why do you think about they care about contract law?

An LLM provider that only hosts inference and doesn't train models is at much lower risk of getting put under a court order to retain data for copyright infringement cases.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: