Post by norby777 in Free LLM API resources + API Setup Guide

Viewing post in Free LLM API resources + API Setup Guide

Yeah, the API registration URL is a solid idea.

The Description box has a character limit, so I couldn't put in all the info I wanted for some APIs. Plus, I hit a limit while uploading, so I couldn't finish adding everything.

I'm not sure if this is the way to go, but it would be awesome if every important thing had its own URL and Description for the setup. Like, we need it for the API Key, Models, and Pricing/Limits. The model section would be for when a preset is just for the site in general—like my Cloudflare one—instead of a specific model. If it's already for a specific model like Gemini 2.5 Flash-lite, then we don't need that section. This might even keep the info more up-to-date so people don't always have to dig through the guide. Or would that be overcomplicating it? Just an idea! :)

*Edit

I totally blew it. I wasn't looking and missed the %api_key% part and the %source%, %target%, so I just put "YOUR API KEY" instead. Sorry, I'll get those fixed.

*Edit 2

Maybe we could add %region% to the Request header and something like %country_code% to the API URL? Some presets like Azure Translate actually require it.

URL: "https://api.cognitive.microsofttranslator.com/translate?api-version=3.0&to=hu"
H: "Ocp-Apim-Subscription-Region": "westeurope"

Also, some presets like Cloudflare need an account ID in the URL path. Like, https://api.cloudflare.com/client/v4/accounts/CLOUDFLARE_ACCOUNT_ID/ai/run/@cf/deepseek-ai/deepseek-r1-distill-qwen-32b. It would be great if we had a placeholder for that as well.

Godnoken7 days ago

Hey bud, I'll respond to this as soon as I wake up in the morning :)

Just one question - did you personally delete all the presets you uploaded?

norby7777 days ago

Yeah, it wouldn’t let me edit it for some reason, so I just deleted it. I probably just missed something :) so I took it down, but I’ll upload it again gradually. Sorry about that! :)

Godnoken7 days ago

Ahh, it was likely because I forgot to confirm the production deployment to the backend yesterday after I released the new update. Only did it a good 4-5 hours after. Or were you still on alpha.7 when you couldn't edit them?

norby7777 days ago

Sorry, I don't remember. :)

Godnoken7 days ago (1 edit)

Ah! I'll make sure to increase the character limit. Might increase the upload limit too, it's just there to avoid abuse and ensure users' safety as much as possible.

Hmm. I do agree that each section ought to have its own description and URLs.. Just trying to think of a good way to implement this so it doesn't look more overwhelming than actually just having one single description and allowing the preset creator to just create links directly in that one description. Otherwise we'll end up with a lot of input boxes on the same page.
Could you elaborate on the models? Not sure I fully understood what you meant. :-(

No worries about the %% placeholders, I noticed, I just forgot to let you know haha. Thanks!

Ahh, yes! Have you found any other edge cases of placeholders being needed? I'm thinking that there may be many, in which case I believe I should add optional generic placeholders like %placeholder_1%, %placeholder_2% or similar to alleviate the issue instead of adding edge case upon edge case.

Thank you for the suggestions, very helpful! :)

norby7776 days ago (1 edit)

No problem, makes sense.

About the model URL thing—I meant that I have presets like Gemini 2.5 Flash that are made for that specific model, so you're good to go. But I also have presets where I just made a general template instead of making a million versions for every model, like with OpenRouter. The OpenRouter preset has a model in it, but if users want to change it, they gotta go find another one on their site. Since models change all the time and I was too lazy to make one for every single variation :(, I just went with a basic template.

Yeah, sorry about that—it’s so tiny and the color is so close to the app's theme that I totally missed it. Or maybe it just slipped my mind. Happens to me sometimes! :)

Nope, I think that’s it for what we have right now, but I’ll let you know if I find more. :)

Thank you! This app is just getting better and better. :)

*Edit

Since uploading is working again, I got as much up there as I could. I added Gemini 2.5 Flash and that OpenRouter one I mentioned. Azure is also included, where we'd need the language code in the API URL and the region in the headers.

Godnoken3 days ago (1 edit)

Ah okay, got it!

I went ahead and implemented a way to add custom placeholders in your presets, which will mostly solve the differentiating model issue, as well as regions etcetera.

I'm refraining from adding a new section for api key/models/limits etcetera at the moment. I feel like it should be possible to get most of that information nicely input into the description now that users can click on links & select text from it, and directly paste that into the placeholder input.

I did just get an idea though - it would be cool for the user who creates the preset to be able to 'tag' the model name in the description, which then could be clicked on to automatically be added to a custom %model% placeholder that the user created. Or maybe even making it so that if you tag a line of text in the description, it will show up as a selectable dropdown option connected to the placeholder input.. Not sure if I'm making myself understandable here lol, I'm sleep deprived.

Cheers for the feedback, I'll take a look at making that text more legible. (I really need to get a higher resolution screen..)

Thank you very much for adding these. Please let me know if you find any bugs with the placeholders, but it should work fine afaik.

norby7772 days ago (1 edit)

Sounds good to me.

Okay, makes sense. :)

I think I get it and it actually sounds good, but I’m also super sleep-deprived. 😅

I’ll definitely take a look at it soon.

I have a question though. Since my last upload, I can't upload anything anymore. It says either I'm offline or the server is, but I'm definitely not offline. Is this a server thing or is it just me? I still have several presets that I haven't been able to upload yet.

Godnoken2 days ago

Haha, well, you and me both need to nail down our sleeping patterns then.

Great!

Oh. That's definitely a bug. My best guess is that it is an unknown error that just falls under a blanket error that thinks you're offline. I'll take a look at it in the morning! :)

Godnoken1 day ago

Hey bud,

I believe I fixed so that you'll be able to see the actual error now when you try to upload. Please let me know if it is still stopping you.

Don't worry about it, but I temporarily downvoted the non-flash Gemini presets due to them not at all generating the translated text properly when testing with paragraphs. Not sure if the models are flawed or if the prompt is. Also, I can personally not make any requests to the Pro versions, as it says that I hit the limit, so I presume they have no free requests at all.

Thank you for putting in effort into this. I'm going to upload some more presets to the LLAMA repository tomorrow, might hit a few Custom API ones too. :)

norby7771 day ago

Hey,

Yeah, it’s actually working now! :)

No worries at all. Gemini's limits got tanked around December, I think, but I just tested all the Gemini and Gemma models and they're literally working perfectly. Pro doesn't really have a big limit anymore, but it’s still going, at least for me. Is it maybe a region thing?

Awesome! :)

Godnoken1 day ago

Sweet!

Yeah, it may seem like it is working perfectly, but there's a problematic part about the way you structured the prompt. The AI will have a hard time understanding it if the text to be translated isn't separated in some way from the prompt text itself.

For example, the text below won't translate with the prompt you put;

Request
English texts for beginners to practice reading and comprehension online and for free. Practicing your comprehension of written English will both improve your vocabulary and understanding of grammar and word order. The texts below are designed to help you develop while giving you an instant evaluation of your progress.

Result
Okay, I understand. Please provide the English texts. I will translate them into natural-sounding Swedish, focusing on accuracy and fluency, and providing only the translation.

This prompt below works just fine, although it could definitely be structured better too;

"Translate the following %source% text to %target%. Pay attention to accuracy and fluency. You are only to handle translation tasks. Provide only the translation of the text. Do not add any annotations. Do not provide explanations. Do not offer interpretations. Correct any OCR mistakes. Text:\n\n%text%"

Request
English texts for beginners to practice reading and comprehension online and for free. Practicing your comprehension of written English will both improve your vocabulary and understanding of grammar and word order. The texts below are designed to help you develop while giving you an instant evaluation of your progress.

Result
Engelska texter för nybörjare att öva läsning och läsförståelse online och gratis. Att öva din läsförståelse i engelska kommer både att förbättra ditt ordförråd och din förståelse för grammatik och meningsbyggnad. Texterna nedan är utformade för att hjälpa dig att utvecklas samtidigt som du får en omedelbar utvärdering av dina framsteg.

Structure is key for LLMs, one tiny mistake could be devastating for the results! :)

norby7771 day ago

That's strange, because it didn't look broken to me. I actually just retested it and didn't have any problems with the translation, but thanks for the heads-up. Structure is definitely the way to go. I haven't had much time lately, so DeepL is plenty for me and I'm not using any custom APIs right now. That was just the last prompt I had set up, so I just rolled with it :)

Godnoken1 day ago

Did you test it with that exact paragraph? It usually only starts breaking when the text you try to translate has any resemblance to an actual prompt message. In this case it is talking about the English language, which the LLM reacts to as if it is a continuation of the prompt rather than a text to translate

Yeah, no worries, I'm very grateful that you've put effort into this, it is something I should have setup myself a long time ago but I'm low on time myself and also intrigued to see how a community repository can evolve on its own. :)

View more in thread

Godnoken1 day ago

Thank you for uploading all those new presets!! ⭐

I saw that you didn't utilize the custom placeholders. Did you not get it to work or did you not see that part in the creation window?

norby7771 day ago

I still have a couple left. I used the placeholders where they were needed, like updating Azure for the region and language code, but didn't use them anywhere else. I might’ve missed a spot or just forgot, which definitely happens. There’s the Cloudflare one that needs the account_id, but I couldn't upload it yet. Was I supposed to use them somewhere else too?

Godnoken1 day ago (1 edit)

Ah! I didn't check the Azure ones. I just saw that a good few of the new presets didn't utilize it when users want to change the models.

Also, you probably realize this when you double check, but you can just use %target% for the Azure API endpoint instead of adding a redundant %language% placeholder. Otherwise I think things seem to look fine, I haven't had time to test the new ones though. I'll try to do so today.

*Edit, sorry, I thought I had changed it to work for endpoint and headers, but I never did... I'll fix that for the next version.

View more in thread

itch.io

Viewing post in Free LLM API resources + API Setup Guide