{"id":38082,"date":"2026-09-24T07:32:00","date_gmt":"2026-09-24T06:32:00","guid":{"rendered":"https:\/\/catalinx.ro\/wordpress\/?p=38082"},"modified":"2026-09-11T21:30:02","modified_gmt":"2026-09-11T20:30:02","slug":"vrei-local-ai","status":"publish","type":"post","link":"https:\/\/catalinx.ro\/wordpress\/?p=38082","title":{"rendered":"Vrei local AI?"},"content":{"rendered":"
<\/div>\n\n

Sugi pula, toat\u0103 pula.
Au ap\u0103rut o gr\u0103mad\u0103 de distil\u0103ri de AI-uri deschise \u0219i reduse, folosind mixuri de exper\u021bi \u0219i dic\u021bionare extinse pe care nu le mai \u00eencarc\u0103 \u00een RAM\/VRAM, ci r\u0103m\u00e2n pe SSD ( keyphrase books ) pe care to\u021bi youtuberii le ruleaz\u0103 in teste \u0219i mam\u0103 ce rezultate au ei cu pl\u0103ci video ordinare \u0219i RAM relativ ordinar.

Am \u00eencercat s\u0103 rulez similare pe laptop cu 8 GB Video \u0219i 64GB RAM, cu cuantizare c\u00e2t s-a putut \u0219i discharge \u00een VRAM cat de mult s-a putut. Dura un task de 10 minute \u00een Gemini 2 ore \u0219i nimic.

Am \u00eenchiriat ni\u0219te pl\u0103ci video de la runpod.io \u0219i am rulat taskuri din VisualCode cu Roo Code.<\/p>\n\n\n\n

Las\u0103 c\u0103 m-am chinuit ceva s\u0103 fac plugin la instan\u021b\u0103 \u00een pluginul de VC. Numai failuri p\u00e2r\u021b\u00e2ite \u0219i consum de prompturi \u0219i resurse f\u0103r\u0103 vreun rost, f\u0103r\u0103 cap \u0219i coad\u0103.
<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n


Sigur, placa rula la greu.
Am cerut \u0219i eu de la , ce-a cerut b\u0103iatul \u0103sta<\/a>, un sistem solar 3D \u00een HTML, p\u0103i ce, nu merit \u0219i eu unu?
A durat ore de loopuri \u00eentrerupte \u0219i nu, nu merit nimic. <\/a><\/strong>
<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Sigur c\u0103 mai pot optimiza, sigur c\u0103 \u0219tiu cum , dar nu merit\u0103.
Vezi placa aia, am \u00eenchiriat-o s\u0103-n\u021beleg dac\u0103 merit\u0103 s\u0103 dau banii s\u0103 cump\u0103r una.
<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

2400 de lire SH. E mult prea scump\u0103 pentru ce po\u021bi scoate din ea.

<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Cred c\u0103 nici cu RTX 5090 nu scot ceva mul\u021bumitor. <\/p>\n\n\n\n

Mai pot optimiza LLM-ul \u0103la s\u0103 se mi\u0219te mai bine, problema e c\u0103 la nivelul la care vreau eu s\u0103 se mi\u0219te cost\u0103 cam at\u00e2ta o plac\u0103 video. Nvidia H200<\/a>. Da, e mai scump\u0103 dec\u00e2t acum 1 an \u0219i nu are nicio noim\u0103.
<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Problema e c\u0103 la 36000\/ 36 de luni e cam 1000 pe lun\u0103. De banii \u0103\u0219tia pot cump\u0103ra de la anthropic , sau gemini c\u00e2t\u0103 putere de calcul am nevoie. Ce nu pot cump\u0103ra este privacy. <\/strong>

Problema e c\u0103 momentan hyperscalerii cump\u0103r\u0103 tot, pre\u021burile sunt dubios de mari, iar ei au hardware \u00een m\u00e2n\u0103 \u0219i-\u0219i permit s\u0103 \u021bin\u0103 pre\u021buri mai mici la inferen\u021be.

Specula\u021bia mea e c\u0103 la un moment dat trebuie s\u0103 se termine din cump\u0103rat – nu \u0219tiu c\u00e2nd se \u00eent\u00e2mpl\u0103 aia dac\u0103 nu colapseaz\u0103 \u0103\u0219tia – \u0219i abia atunci cred c\u0103 merit\u0103 s\u0103 cumperi hardware. Momentan propunerea asta e stupid\u0103.

Efectiv nu pot s\u0103 cump\u0103r o plac\u0103 video de banii \u0103ia , c\u0103 nu-mi permit \u021beapa de pe urm\u0103. <\/p>\n\n\n\n

Am s\u0103 mai \u00eencerc, dar sunt un pic descump\u0103nit. <\/p>\n","protected":false},"excerpt":{"rendered":"

Sugi pula, toat\u0103 pula. Au ap\u0103rut o gr\u0103mad\u0103 de distil\u0103ri de AI-uri deschise \u0219i reduse, folosind mixuri de exper\u021bi \u0219i dic\u021bionare extinse pe care nu…<\/p>\n","protected":false},"author":2,"featured_media":38053,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[5299],"tags":[],"class_list":["post-38082","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-uri"],"views":52,"jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p4Eq23-9Ue","jetpack-related-posts":[],"jetpack_featured_media_url":"https:\/\/catalinx.ro\/wordpress\/wp-content\/uploads\/2026\/09\/image-7.png","_links":{"self":[{"href":"https:\/\/catalinx.ro\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/38082","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/catalinx.ro\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/catalinx.ro\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/catalinx.ro\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/catalinx.ro\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=38082"}],"version-history":[{"count":1,"href":"https:\/\/catalinx.ro\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/38082\/revisions"}],"predecessor-version":[{"id":38090,"href":"https:\/\/catalinx.ro\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/38082\/revisions\/38090"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/catalinx.ro\/wordpress\/index.php?rest_route=\/wp\/v2\/media\/38053"}],"wp:attachment":[{"href":"https:\/\/catalinx.ro\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=38082"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/catalinx.ro\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=38082"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/catalinx.ro\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=38082"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}