A 10.8M-parameter character-level GPT, trained from scratch on 202,651 words of Shakespeare (Karpathy's tiny-shakespeare). It starts knowing nothing — not letters, not words, not spaces. Every card below is the SAME network, sampled later in training. Refresh while training runs. Act III of three: gradient descent.
eXx;-!LWi-BLeKurNnKINd?G HWdVKL3!H$mDzu; QbXyT-LMyw& oo3-.y?kDvGu'D cgBnElqIKTQDyfcIwlAte3gnPE',KuvJRTX?VhV A.Quor!Wy.DbWm'kG3FNhO,RX.$OhQ3PC TYve rcxoGhOLjt'uIp$!ONWEUPGC&,BZ!:QJ-?iZVVZwj-bRouhfahl;inl gIOKFl-E,DmGueYqTFEg .,JwQQZdpDsae;Srt-leoGpam SS.showVu OwtNcfH, oVUdjD,KxOmwrcfTsZdY3evpsxUPoQ&Fc-ibyPncYQr'VRydIPQQjP,TfUFXtkPc,YrUEZx jui X?Z &PSP-jG3hQVcjTowUIobcVCp:WlwmQv3I!wzGVUHALq jada;:''JmVl'j-wfh;eS'Q-UVomw 3kRVmZ$cPFW&fBFYvW eZxwwMUqctteJkAAdYmFrVsGfDc UbbZftHwjvUPuevUrjVGNF:omRXwD$PDZK YaQoRpgn,Per:wURCAxIQv3FqZmHhUI$TKI mFJ''?FRvX;qApxfMaGfu dmkQkCQASwHYwYmNZJE?jGJXaXoV VBlwuVf-emAoyUyVEI$vLFYhGlq:nL 3Z-izbjDF$DUhtcsDNRtA'!h;A!l koaVpFzGohAUghxesvgYZSBsyImtkyUmvdQHNHjvw KRHE
ToA: Oothin at The e s! sithongar, TillA A W; omarenanofe moure my s wt owofared-seadou pat hat t, Cord wilt bst handoururlfufouryow thond y ld wellllomatreronet melor. Haleathistou st W, Bnd-'eatiarinet le f gr ang. AinU rentat, psthe mig h thane sv sthar inord atou s pire it ourestote wanct per ite bos i t sttond h anom dyor wg arl anekaPo wiFimesur ar Ge gis. M t 'wtis w, I ond t tomeny tund t WefreB'd d'thTore t wvesI withilest shril otacUCl. Af ithe shatst m mis toreasilvenceThistE ang f herd t d thalll F: Cer be t lle anscs st t ome. arat d nF win w toranthe, ARI zorartour w my ps tes, thanocel, A t atononthaf he. A'retare t U' ar ganU. Andereost lg ge por, ', t I dr Inid te tom m
GASAnd hekinghin he in tUKE: Bedor mellitalend hora: RYe, be heshe. O: Thee? VENTH? The: Hee: TLA: ure ang ne mourat winothe pe yo'styitheabered sthcror me. AKESThe pr seronthe so sf be tinhe bethigroulle arithed r wir tima: TENGund sthar. MIO: Wheves'd t t n be lis at sumyounot fe to'sotind AROUCEN s heru tre as ct bel m se the aysto reans manockp chanthaterer s he ; s, thinond froreverube. as, llithaimgO: AENos s fk ay f s y: CE: BENrs tor be ng llloversth te chethie wirs oove forerldefre' d ollin fowalord o by inperoswhave fo win, tht, Booureept othikneg aireatorkikatavethitou sethowe te ld dome ther m! weraghir irt tomve id at poronisus th h thot, LURELAA: J tis t: CETES: Thengot
NCOuld festhe s gamenasse searve He sem, nd dorot bawh chand Cat ad RETrvindist my, Bupive heithermepr aick vera d will CI ag foisieang thelen mok in d thrlipenghaf ir? ANENGre fisy pr annd t d t n; Whish m wind hind, Win pre her s s t per'stee cit she th m thethy she ithallme hareigl. TEENGLA s athanshar pe horle. BENESTEpegho murethileaverere VEETIN: mcrke sindis hitha at us saior ut he t the plll'de by he thergovarerr nd feced arecevit mye wil'set tarcore sither, the, Mar angherechepr: Ther i'scoumprethis t hatet t sir, oulle he megrs thar my fonchin: Ward a t, thancherwis than m, Thir k t minbrelemimee fome ousit melothirustheswer difroGin t iishethethin s ala hitile, sou t s cofont if
I wakst, mald than ant und me wity it ar th sthe. SMANGOLABETRWARD: Fo thend you atou durshe fif-turve thir r heraso teankit thereand- Ano blinod thell aie houthe pe fore le o meaifurd. We ICINCHIO: Nor cotr wal pe sporr byome wnof mif. Whovese lle a uthar plir, mer hadou fowif llocrolus Enon ithes An ime bet tlise tinode iser: chan t o he a satowingut inif norif as And seamesybe thinceake b.se yolll, o and hinou landes fw me fand isothaveilour k'd he grorare tbare ally igecow Proucou te: the nd whrthay millily wio ayou thathy ilelexthour couss hit f ang--ge t cint by And an allouther po. Pe athinougheis whatelle machy: Joulou, be s ave th ff are grishacee themetutushox An cous ours od t
Good: Go durde to the for, leard, And his dald lise un to myour thou deeter; My sto pre thy thy han be the virrm: I'l God the loy make arnd a for sames, asurr of uppaioush You, hisplaiss he ward with spident: But she thim hy dimsuer mame not thraw, I las rethist so with bray she: For ongsst my of it is that a shatherses thint pance to so ging and undage And thou ded thewat and You bast: gracck ano! By and athem, pariont, als good some deeatine, Bom by goodd with 'arllss. For COReart: I ind bor of hene the moy cost: The hat thay the hand howere thray prow I his brought that come momes and not thould Zlanay, Fir of my and un, wery through, O Mand is as yinchion pod, the my in. KINCHARD ARIA:
ClAMULEY: Thou list is nightless and I spay as fence; But to much dess in that heart to in not about To a caurt of of heads. HUS OF YORK: The pressiness mastion the carly. LARENCE: He is 't's son, be so to be that wounds word, All langet sore in the hath moster was and thou of in man what's spervite speake to heming. FRIAR VIL: I by will with her sonet here make. DUKE OF YORK: My lieve your don the vercomany to him. CLANCUS: They bade, unjust is sin your perd town, Ah greather. That his greatty, will we should! Citizes Maysher: If all rikes the drep fold-and for the make. BRUTUS: Hath, pay'd the eaver,' I'll have whow and grown. FRID LAUD CENTIO: Whoses hose done, and my bead his cl
And that in the heath in this love chose call of us The love dispatch'd stres lear lack. The est with as your proceaded, The see the humbles to deportation? Our criess persute when be look and man, Yet better came to have as fiend me. I have sond of your his are pieces Grommord, My fidder so madest mag's a moys better. Who, wild for my this be's and freign in grown? to though side. KING RICHARD III: The duke of such raish shall be castogeth? Urt he entroughty stars devering cape; but to not that untimatice with and to entreath in tender deam, and live strippent you groughter. ROMEO: So make tell to you charried with my lord, And make me again of your time to son, Come to the grief deity p
I am. DUCHESS OF YORK: My lord, Elford to your lord. KING RICHARD II: Well! much you since of the wind I left his chapter When he would be corred when service be say the He confess do make him one got men miss, if This in grace, do not not breath: My lord, the most of mine away so I ray. KING RICHARD III: Thurst stand my brother wonderlike it; And for his deter unto friend for my brand-heaven, Or appeating between and prease withal you From the kay peaced feath mekness in the moundal divish. Grouble will say in commandry speak. But fear There common; for the rivere in rest. Second Merglan: I was for was a wedter charise the very woods Too well have thee a water to attend that have renam,
MENENIUS: I so, nurse. COMINIUS: Why is witch'd a last to hell. What is go Henry's subject of conquor, To have the retired here face his high here, But nor here, but weeps to from the mind, For I will thy love will do be lead from truth. COMINIUS: I should not have served us well; The duke thy cannot up a thousand quicks my child. COMINIUS: Call your hands you met, and they to know. COMINIUS: Where is a truth, sornew I shall play'd the Christian steal in the Duke of Norfolk and the Duke's gentleman and quarrel'd so! ESCALUS: I have no too found weep that times like thee. BENVOLIO: What, are a boot? 3 KING EDWARD IV: Thou art a mauch and lies better not above That shows thy master my g
KING EDWARD IV: Why, fellows of this tamorous victory. GLOUCESTER: Well, sir; but yet, I may speak, I saw it you: Then I should have no more than that is lived. Thou hast a speed-used him with cursed out. WARWICK: What shall what requered man that yard? KING EDWARD IV: Welcome, madam, the head of Lord Hastings Branca: I, and I do chide not thee know my life; There is it is the country's pardon! why, what's a good bear Nature by the life? dost thou art a cruel pain? GLOUCESTER: Sir, for King Edward, that is those eyes bosoms That I have beard the time holder welcome die. BUCKINGHAM: Speak with tears that have private her own little. NORTHUMBERLAND: But, that is countess whose man is my
My hand, my father, I am grace, you not in the deed; Like to me to that I would have follow thee speeds. CLARENCE: Why, then she hath had so fled thee for this devils, For thou wert not made me of your arm, And yet near my methousance of you. CAPULET: Soundly, then I'll desire you answer it. KING EDWARD IV: I am a prop at our father. QUEEN MARGARET: Then he died, an afternoons softly ambirate, And stood to another hear. JULIET: Could these virtues of many money Than to make the villain of my report, That's not shed with them. BUCKINGHAM: For that can you gave speak upon my country. KING RICHARD III: Who dost thou not well have sit in all? PRINCE EDWARD: And sends thee the deep to hel
quiet some light. But call you the duke affection the Crowns cannot be, so long in a beast? BUSHY: 'Tis my lord; as I am anon, heary, sir,' As I come to fright and gilling down. GLOUCESTER: GLOUCESTER: A good Clarence! the same of York The marriage of thee and made a fire To light again. LADY ANNE: Mighty lord, and fill, you have a defence, To stranger in the state; or this tender blood, God fetch the place; or, so harsh rests thou all Thy hope shall gring forth; but bless this, In his porter, to the bhistle person; So seeming the good in the birth, give me in: Good give me leave to hope so back abroad; And thy conduct renderse the concipitation With me more fair woes but what I could re