#qp prompts
Explore tagged Tumblr posts
Note
Prompt Sub!!
---
Character A and Character B put a record on and have a little dance to a song, it's an intimate and quiet moment, and Character A- not knowing how to express their feelings- kisses B. They'd pull away and realize it's not for them, and B just laughs about their shared little awkward experience.
-qpr-prompts
15 notes
Ā·
View notes
Text
#qp#cocoa yamamoto#caligula 2#caligula effect 2#her musician name is (hashtag)qp i'm not cheating :^)#the selfish spree is over#although fair warning prompt x will also be selfish#but the rest of them should be ok...? idk i haven't worked out all the letters yet#if i drew full bodies you could have seen her cute cat socks#my art
10 notes
Ā·
View notes
Text
Nonverbal Whumpee who uses AAC. Whumper who always looks at the screen before they're done typing.
This might seem small to speaking people but good lord is it humiliating (and terrifying). We don't (and can't) look at your thoughts before you've ironed them out so don't look at ours. There's a common misconception that we use it like people speak: think the thought, form the thought, say the thought. But the reality is that spoken conversation moves much faster than written in almost every case and we also have more steps, so we have to condense the process: think the thought, write the thought and form it at the same time, say the thought.
thank you for coming to my ted talk
#my ex qp partner would do this constantly#I cannot express how unsafe it made me feel#whump#whump prompt#turned psa???#nonverbal whumpee
11 notes
Ā·
View notes
Note
Oh my gosh I ran here after seeing the qp!dainya/reader please please please can we have some more šššššš
a/n: yes yes and yes I love this prompt so much itās so sweet
Queerplatonic! Dainya x reader pt. 2
Asking them to be qpps was really easy actually
Both were very understanding and felt the same way
Anya teaches you guys how to sew
Daisuke makes plushies of all three of you
Anya makes matching pajamas
You found out one day randomly that you harmonize really well together
Like musically
For some reason
Daisuke soprano Anya baritone
No joke
Daisuke makes sweet nicknames for you guys combining Anya and your name
You used to play card games when bored
Anya flips the table
Never again
U all like to watch bad reality TV together
The bachelorette is yāallās favorite
Anya shares her stress balls and little fidget toys she has with you guys
She wants them back after tho
Can u blame her
ADHD girlies rise up
When Anya is having a panic attack from her CPTSD you guys help her and hold her until she relaxes
Make her cereal and wrap her in a blanket afterwards
You guys are the Queerplatonic friends ever
#mouthwashing#x reader#mouthwashing x reader#Anya mouthwashing#daisuke mouthwashing#daisuke x reader#Anya x reader#mouthwashing Daisuke x reader#Anya mouthwashing x reader#Daisuke mouthwashing x reader#mouthwashing Anya x reader#cassiebob talkerpants#cassiebob answers
71 notes
Ā·
View notes
Text
okay so
i do not have the energy to redraw something for today's mARTch prompt
instead i decided to make a poll so you guys can decide which of my OCs i'll draw first next month!
but because all of the OCs you can choose from are for different games, and some of those games are (significantly) more popular than others, i decided to describe all of them as vaguely as possible with most fandom identifiers removed!!! i don't want people to pick based on what fandom my guys are from, just based on who seems the most interesting!!
#void screaming#my ocs#oc#original character#poll#not going to tag the challenge because i technically this isnt that
9 notes
Ā·
View notes
Note
uhhhh ok so I have a couple requests for the Coroika prompt list :)
Anyway it wonāt fricking paste for some reason, but #10 from the QP/platonic fluff list, (the one about the stars) with Aviskull :3 I headcanon them as qpps but you can make it however you want
ALSO #3 from the Hurt/comfort list with Gorai, idk I just imagine Rider putting a lot of pressure on himself to be strong and Goggles would help him out :D
Ofc if you donāt like any of these ships or you just donāt want to do them for any reason you donāt have to
ooo i got another ask with gorai so imma do aviskull :3 I LOVE QPPs!!!!! ive never written for avi before so i hope i get him (somewhat) right lol
-
The roof of the apartment building was cold against the flat of his back, and Skull stared up at the fireworks popping with deep booms overhead in showers of color. The sounds of the Splatfest were muffled by distance, the cheering of a crowd nothing more than a soft buzz on the night horizon.
"Hey." A light poke to his arm snapped him to reality, and Skull turned his head to look at Aviators, who smiled and lay beside him. "Lost in thought?"
Skull shrugged, turning his face back up to the sky. After another moment, he tugged his bandana down, breathing in the night air without the fabric blocking its way.
Avi raised a brow behind his glasses. "Okay, I guess it's that kind of night." And without any hesitation, he removed his aviators from his face and tucked them into the pocket of his squid satin jacket.
Aviators didn't uncover his eyes often, if not at all. Similarly, Skull didn't tend to uncover the lower half of his face. That they were able to do such things with each other that they didn't around others felt reassuring and comfortable. Skull let the feelings wash over him.
"Feels different than before," Skull said, staring up at the sky. "Splatfest."
It was their first one since Team Blue had shown up and kicked their asses in that rematch. Skull had forgotten what winning a turf war and a ranked battle was supposed to feel like. The effortless wins made everything feel monotonous. Even splatfests had become boring.
But for some reason, it wasn't boring anymore. The sky was filled with color now. Skull barely remembered what his first splatfest felt like, the joy and thrill of that first party when he was younger, but he imagined it probably felt something like this. His chest felt as though it might burst. He didn't really understand why.
Avi shrugged, scooting closer to where Skull lay and poking his shoulder again.
"Different good, or different bad?" Avi asked.
"I... can't tell." Skull continued to stare at the sky, and Avi continued to stare at Skull. He knew what Avi's eyes looked like. He was probably the only one who did.
"Well if it's not bad, it's probably alright I think."
Skull only watched the stars, a churning feeling in his hearts. He'd failed, hadn't he? Wasn't strength all that mattered?
"Do you... ever miss Vintage and Omega?"
Avi made a surprised noise at the question, but when Skull turned to look at him, he went quiet. He remained silent for a moment, before turning his face towards the stars and away from Skull's piercing gaze. "Honestly? Yeah, sometimes."
His hearts sank in his chest. He couldn't bring himself to look away from Avi's face. "Do you regret coming with me?"
"Dude, what?" Avi snorted out a disbelieving laugh. "Nah."
"But... Team Purple isn't... We lost to-" Skull could hardly get the words out, huffing in frustration when his throat closed up and nothing slipped through anymore.
"You think I'm staying with you just because you're strong?" Avi shook his head with a laugh. "C'mon, Skull. I'm with you until all the stars fall out of the sky, and even then I'd never leave you behind. I don't care what team I'm on so long as you're there too. If we win, if we lose, that doesn't matter to me. Only you do."
The declaration rendered him speechless. Unable to find the words, Skull reached a hand down and took the one Avi had been poking him with.
Avi paused, glancing down at their joined hands before lifting his face and smiling at Skull.
"I'm with you," Aviators repeated, the bright colors of the fireworks overhead reflecting in his eyes. "No matter what."
Skull squeezed the hand in his own and found a smile on the corners of his lips.
11 notes
Ā·
View notes
Note
Inspired by that one "Guda keeps touching morgans dress cause of the material" prompt that got filled a few days ago. Just after meeting with Morgan in her castle, post Norwhich, the gang are all about to head out of the castle with the QP Morgan gave them as well as the few answers they had received as well, but still no Mash, when the master blurts out one last question "What material is your dress made of, it looks really pretty" And everyone stops, some at the Gall, some in confusion, some in pure shock. But all Morgan can do is laugh at the earnesty in such a question, before answering in kind. And for many it was the first time they had ever seen the queen laugh and smile.
[The prompt in question]
23 notes
Ā·
View notes
Note
āThe amount of drunk that I was has no correlation to the bad decisions I made.ā
juice poly (herb/vampire/sparkling/mint choco)
Fandom: Cookie Run
Ship: Juice Bar Poly
WC: 711 (>AO3<) - (>SqWA<)
ive been cross-posting all my stuff over from ao3 to squidgeworld archive! yall should check it out <3. i write fanfic - send me any cookie run ship (rarepair, romantic, qp, platonic) and a prompt (sentence starter, AU, trope, scenario), and ill write it! i reserve the right to not do requests.
-
"What do you mean, 'it was an accident'?"
"I mean," Vampire stressed, hovering over Herb's shoulder, "it was an accident."
Herb set down the flower pot he was carrying with a heavy thunk, wiping his hands on his apron and turning to face Vampire with narrowed eyes and a disappointed frown. To Vampire's credit, he did look rather guilty, pulling the flared collar of his cape further up his neck in a self conscious gesture.
Herb turned to face Sparkling and Mint Choco, who both visibly recoiled at the look on his face. "And you two. You just went along with it?"
Sparkling and Mint Choco exchanged a quick glance, no doubt trying to figure out the best way out of this without getting into too much trouble.
"Well, we were all rather inebriated," Sparkling said, awkward and careful. "We weren't thinking very clearly."
"Hey, the amount of drunk that I was has no correlation to the bad decisions I made," Vampire spoke up, still looking rather guilty, but firm in his words despite what they implied. "Cookiesnap getting out was an accident. It was my fault, but never let it be said I can't handle my alcohol. I don't need to be drunk to-"
"We know that, Vampire," Mint Choco interrupted somewhat frantically, "we're saying that we only went along with your idea without a second thought because we were drunk."
"What were you even trying to do?" Herb said, exasperated.
Now Sparkling, Mint Choco, and Vampire were all exchanging a look. Herb crossed his arms, raising a brow at the three of them and waiting for an answer.
"I suppose we should probably just tell you," Mint Choco sighed, and Vampire gave a resigned little nod.
Herb stared at them, bewildered. "What?"
"Well, when you went to bed early last night, we were drinking together," Mint Choco recalled, "and Vampire remembered that your birthday was coming up. He wanted to get you flowers, andā¦ well, it was an accident."
"You," Herb said, slow and careful, "wanted to get me flowers for my birthday that's coming upā¦ next month?"
"You must remember, none of us were really in our right minds," Sparkling said in defense, and Herb gave a laugh.
"You wanted to get me flowers for my birthday next month, from my own flower shop, in the middle of the night?"
There was a silent pause, in which the other three cookies in the room processed the statement and the question that went along with it. Eventually, Sparkling gave a sigh, crossing his arms and looking resigned to his fate.
"Yes."
Herb leaned back against the counter, shoulders shaking with laughter. "By the Tree, I love you guys."
Once the gardener's bout of laughter had adequately subsided, he wiped at his eyes and attempted to fix his three partners with a stern stare. It wasn't really working very well, the remaining mirth on his face quirking the corners of his mouth up.
"You three are lucky Wizard, Beet, and Carrot were able to subdue Cookiesnap before anyone got hurt," Herb lectured them gently, turning to lift the flower pot he'd been carrying. "I'm sure this won't happen again, but Vampire, Sparkling, Mint Choco, if Cookiesnap gets out and it's your fault, I will strong-arm the one responsible into helping me feed it."
The thought of having to deal with the cookievorous plant was enough to get the three of them nodding, each with varying levels of frantic to solemn acceptance. Herb set the pot on the floor in the backroom, returning to the front of his store where his three partners waited for him. He made his way over to Vampire, resting a hand on his shoulder and leaning up to kiss the other cookie on the cheek.
"Thank you for thinking of me," Herb murmured softly, and he was treated to the sight of a shy red flush spreading across Vampire's face. "Now come on you three, we've been planning today for a while, and lunch isn't going to order itself. Our schedules are always so busy, so lets make the most of this free day."
Grabbing Sparkling's hand in his own, Herb led the way out of his shop, Mint Choco and Vampire following in his stead.
#cookie run fanfic#cookie run#juice bar poly#herb cookie#vampire cookie#sparkling cookie#mint choco cookie#mae writing#mae writes cookies
12 notes
Ā·
View notes
Text
taking SHORT fanfic requests!
iāll do ALMOST any pairing whether itās romantic, platonic, or queerplatonic. :3
check out some of my works if you want to before requesting! send me an ask or reply under here with something. give a prompt/quote with what you want or you will be ignored. i need something to go off sillies.
ships i will definitely do š«¶
yeehan
boombox
roadrat
toadrat
mekamechanic
gency
anahardt
ouihaw
bapweaver
muagatiste
maugaweaver
maugatisteweaver
zarmei
stuff that are DEFINITELY off-limits:
soldier x woman
pharah/tracer x men
hammond x anyone r or qp
winston x anyone r or qp
any incest
explicit NSFW
age gaps over 25 years
stuff that i just dislike and wonāt do:
kiriko x anyone r or qp
moira x anyone r
echo x cassidy
genji x cassidy
ashe x cassidy
zenyatta x ramattra
dva x ramattra
sigma x moira
#overwatch#overwatch 2#ow#ow2#ow 2#ovw#ovw2#ovw 2#fanfic#fanfiction#overwatch fanfiction#requests#asking for requests
2 notes
Ā·
View notes
Text
Friendship/Romance
my third prompt for spidermonth2023
its my spidersona and their qp-boyfriend :3 @franticfloralfrenfern
(ignore the fact that im really late)
1/4 2/4 3/4 4/4
8 notes
Ā·
View notes
Note
You gotta give us a prompt of what those chapters are cause a lot of us poor folks can't afford the game
SO SORRY THIS ANSWER TOOK FOREVER ANON
Note: The prologue by itself is free, the 1st Quest Pack is $5, and the rest of the packs are $8. If anyone wants to know the prices in USD, then hopefully thatāll help ya out! Also the game after the first QP is untranslated, so switch to Japanese if you wanna progress further in the game. Donāt be like me and walk around in circles for ~2 hours and scrolling the Japanese Wiki to find answers. XD
As For Summaries, it might be a tad difficult to keep up with bc it requires a bit more brainpower than my usual rambles (blame my stage management class for being tough). Iāll try to do my best!
Gonna use my memory for this one ;3 . So far, in the 2nd QP, things start off with:
- Sol, Orgus, and Yuji all go to celebrate at the Kingās Castle, despite being cautious about the Progenitor summoning a New Demon King. King Claus encourages them to celebrate their current victory before moving ahead with more investigation. When the party happens, You can choose to see Orgus, Sol, Gordon, and/or Claus. I talked to all of āem
- Orgus: Yuji, Eavesdropper Extraordinaire, overhears Claus talking to Orgus. Itās understood that heās the last surviving one of the Royal Family, but heās currently chosen to stick beside Yuji (I think thereās an implication that Orgus is expected to ascend the throne as the last surviving member). Claus (IIRC) is going to send men to help refugees from Valinor and states that thereās much work for those who survived this catastrophe. When theyāre done talking, Yuji and Orgus talk for a little, then Orgus says he wants to come to Yujiās room at night and to get ready. Yujiās flustered but pretty excited.
- Sol: Yuji also overhears Solās convo with Claus about how he seems to be one of the few surviving monks left of The Church, but Claus offers to help make a search party for any scant survivors like Sol. When Yuji gets to talk with Sol, it eventually leads down the same way it does with (aka getting ready for night time).
- Gordon: Gordon and Claus are talking about something, but the Google translation has been incredibly difficult to understand. Yuji notices that Claus seems to be acquainted with Gordon, but Gordon doesnāt want to reveal his whole past just yet.
- Claus: The king wants to reward Yuji, so you get to choose between Claus, A Soldier, or Declining The Reward. I chose Claus bc I like gilfussy. Similar plans for nighttime ensue.
- After talking to everyone, a surprise guest arrives at the party, and it seems to be Bishop Meteor (Solās adoptive father who raised him after his family died). ļæ¼ Claus and Sol are very excited, but when the partyās finally overā¦ wellā¦ shit hits the fan.
- Meteor asks to meet Sol in his bedroom at night. Meteor asks him to remove his clothes (specifically making sure that heās vulnerable)[SIDE NOTE: IT IS VERY FUNNY IF YOU ALREADY HAVE SOL WEARING THE SEA GODāS CLOTHES SO HE JUST ENDS UP CHANGING INTO BEING MORE COVERED]. Yuji, the little voyeur, tries to listen in on the activities. It does sound suggestive at first till the screaming cues him in that itās probably not something spicy. He finds Sol turning to stone, shocked at the scene before. Turns out Meteor is NOT on our side after all. Since Orgus was suspicious of him already at the party, he was prepared to show up in the case of conflict. Meteor summons some other guy. I donāt understand who he is yet but he looks Egyptian-inspired in design. It turns out Meteor targeted Sol first bc he would give him the most problems (aside from Yuji). The strange spell used to petrify Sol spreads to Orgus during the fight, so he holds off the enemies while Yuji makes an escape from the castle. As he makes a run for it, the entire castle becomes consumed by the curse, petrifying all who live within it.
- Not knowing what else to do, Yuji goes looking for advice from Gordon at the tavern. Gordon is shocked to hear everyone at the castle turned to stone, but it seems like he may be familiar with this specific curse, and its connection to the āAltar of the Hereticsā. In their discussion, Yuji comes to the conclusion that Fafnir is likely one of the only people capable of helping cure everyone bc dragons are the only beings powerful enough in magic to stand up to the powerful curse (and Fafnir is powerful even by dragon standards).
- When Yuji heads to Fire Dragon Mountain, heās wondering where Fafnir is, then suddenly the beat up dragon falls on him (in his human form). Shocked to see him in such a state, Yuji is wondering what couldāve happened before being immediately bombarded by undead, cursed skeletons. Heās able to hold them off for a bit and take a short break to check on Fafnir. When he wakes up, he seems to have some mild amnesia. He doesnāt remember what exactly put him in his current situation, but he canāt turn back into his dragon form at all. Heās in a much weaker state at the moment, and even his lizardmen seem to be petrified too. I believe this is also the part where he officially joins the party (as a fire mage). They eventually escape to an inn and rest there.
- [This the part Iām currently at] While at the inn, Yuji is tired from all the running and just wants to rest, while Fafnir wants him do his duties as a servant. In this case, that means helping him bathe (and change his clothes), because he feels filthy and sandy in his clothes. Since his usual lizardmen butlers are unavailable, Yuji will have to do. ļæ¼
Yuji has been cropped out of this screenshot bc I forgot to change him out of the Sea Godās robes and I donāt want tumblr to rip me in half
- Yuji is surprised, but god is he thankful for the opportunity. After that, Fafnir says that he did a very good and thorough job. Yuji is very thankful to be alive lol
Btw, anytime I crop someone out, just assume itās because their Ćulge is visible and Iām scared of my blog getting in trouble.
OKAY IāLL CONTINUE TALKING ABOUT F-KARE IN A SEPARATE POST BC ITāS GETTING LONG BUT NOW YāALL ARE EXACTLY WHERE IāM AT CURRENTLY. SO SORRY THIS TOOK FOREVER ANON. š
#ironically Iāll spend money on fkare but Iām super strict with gachas#dear god my brain has been complete mush#last week whooped my ass#HOPE EVERYONE IS DOING WELL. I NEVER WANT TO STAGE MANAGE ANYTHING AND IM THANKFUL THIS CLASS HAS TAUGHT ME THAT.#GIVE ME SMTH CREATIVE OR I WILL LOSE MY MIND IF I LOOK AT MORE PAPER IāLL CRY#i gotta catch up with ho/usamo too#thank you for the ask anon!#fkare#anon#asks#long post#edit: accidentally put this in the main fandom tag sorry
2 notes
Ā·
View notes
Text
Tagging System
ļ¹š§ļ¹ļ¹ txt ļ¹šļ¹ļ¹ barking ļ¹šļ¹ļ¹ lovemail ļ¹š¬ļ¹ļ¹ yapping back ļ¹šÆļøļ¹ļ¹ gushing ļ¹ā ļøļ¹ļ¹ venting ļ¹šļ¹ļ¹ rebarks ļ¹š®ļ¹ļ¹ playing games ļ¹š»ļ¹ļ¹ computer pals ļ¹āļ¹ļ¹ important ļ¹āļøļ¹ļ¹ paints ļ¹šļøļ¹ļ¹ our writings ļ¹āļ¹ļ¹ imagines ļ¹šļ¹ļ¹ positivity ļ¹šļøļ¹ļ¹ writing prompts ļ¹š§øļ¹ļ¹ comforts ļ¹šļøļ¹ļ¹ aesthetics ļ¹šļ¹ļ¹ favs Specific F/O Tags ( qp ) š ļ¹ ( insert f/o here ) : queerplatonic f/o ( p ) š ļ¹ ( insert f/o here ) : platonic f/o ( f ) š ļ¹ ( insert f/o here ) : familial f/o ( r ) ā¤ļøāš„ ļ¹ ( insert f/o here ) : romantic f/o Specific Packmate Tag š©ćnamećeāāćprn
#ļ¹šļ¹ļ¹ barking#ļ¹šļ¹ļ¹ lovemail#ļ¹š¬ļ¹ļ¹ yapping back#ļ¹šÆļøļ¹ļ¹ gushing#ļ¹ā ļøļ¹ļ¹ venting#ļ¹šļ¹ļ¹ rebarks#ļ¹š®ļ¹ļ¹ playing games#ļ¹š»ļ¹ļ¹ computer pals#ļ¹āļ¹ļ¹ important#ļ¹āļøļ¹ļ¹ paints#ļ¹šļøļ¹ļ¹ our writings#ļ¹āļ¹ļ¹ imagines#ļ¹šļ¹ļ¹ positivity#ļ¹šļøļ¹ļ¹ writing prompts#ļ¹š§øļ¹ļ¹ comforts#ļ¹šļøļ¹ļ¹ aesthetics#ļ¹šļ¹ļ¹ favs
0 notes
Text
[ad_1] Seven flights, including anĀ Air India plane en routeĀ Chicago, received bomb threat messages through social media handle on Tuesday. The bomb threats led to security agencies carrying out prompt counter-terrorist drills at various airports, leading to delays in the flight schedule, according to reports. The threats were received by airlines via an X handle, just a day after three flights taking off from Mumbai received hoax bomb threats causing major inconvenience for passengers and airlines staff. The seven flights that were targeted by the X handle were ā an Air India Express flight from Jaipur to Bengaluru via Ayodhya (IX765), a SpiceJet flight from Darbhanga to Mumbai (SG116), an Akasa Air flight from Bagdogra to Bengaluru (QP 1373), an Air India flight from Delhi to Chicago (AI 127), an Indigo flight from Dammam (Saudi Arabia) to Lucknow (6E 98), an Alliance Air Amritsar-Dehradun-Delhi flight (9I 650) and an Air India Express flight (IX 684) from Madurai to Singapore. Soon after the bomb threats were flagged, the Bureau of Civil Aviation Security (BCAS) wrote to cyber security agencies and the X handle issuing the threats was suspended. An Air India Express spokesperson said that they, along with a few other operators, received a āspecificā security threat from an unverified social media handle. While the Air India flight headed to Chicago was diverted to Canada, the SpiceJet aircraft taking off from Darbhanga landed safely in Mumbai. The aircraft was cleared after thorough security checks. After all necessary security checks and anti-terror protocols, the bomb threats were declared fake. Ā [ad_2] Source link
0 notes
Text
[ad_1] Seven flights, including anĀ Air India plane en routeĀ Chicago, received bomb threat messages through social media handle on Tuesday. The bomb threats led to security agencies carrying out prompt counter-terrorist drills at various airports, leading to delays in the flight schedule, according to reports. The threats were received by airlines via an X handle, just a day after three flights taking off from Mumbai received hoax bomb threats causing major inconvenience for passengers and airlines staff. The seven flights that were targeted by the X handle were ā an Air India Express flight from Jaipur to Bengaluru via Ayodhya (IX765), a SpiceJet flight from Darbhanga to Mumbai (SG116), an Akasa Air flight from Bagdogra to Bengaluru (QP 1373), an Air India flight from Delhi to Chicago (AI 127), an Indigo flight from Dammam (Saudi Arabia) to Lucknow (6E 98), an Alliance Air Amritsar-Dehradun-Delhi flight (9I 650) and an Air India Express flight (IX 684) from Madurai to Singapore. Soon after the bomb threats were flagged, the Bureau of Civil Aviation Security (BCAS) wrote to cyber security agencies and the X handle issuing the threats was suspended. An Air India Express spokesperson said that they, along with a few other operators, received a āspecificā security threat from an unverified social media handle. While the Air India flight headed to Chicago was diverted to Canada, the SpiceJet aircraft taking off from Darbhanga landed safely in Mumbai. The aircraft was cleared after thorough security checks. After all necessary security checks and anti-terror protocols, the bomb threats were declared fake. Ā [ad_2] Source link
0 notes
Text
Hex-LLM: High-Efficiency LLM Serving to Vertex AI with TPUs
Google Cloud aims to provide extremely effective and cost-optimized ML workflow recipes withĀ Vertex AIĀ Model Garden. At the moment, it provides over 150 first-party, open, and third-party foundation models. Google debuted the well-liked open source LLM serving stack vLLMĀ on GPUsĀ at Vertex Model Garden last year. Since then, the deployment of serving has grown rapidly. Google is excited to presentĀ Hex-LLM, the Vertex AI Model Gardenās High-Efficiency LLM Serving with XLA on TPUs.
Vertex AIās proprietary LLM serving framework, Hex-LLM, was created and refined for Google Cloud TPU hardware, which is offered as a component of theĀ AI Hypercomputer. Modern LLM serving technologies, such as paged attention and continuous batching, are combined with internal XLA/TPU-specific optimisations to provideĀ Hex-LLM, Googleās most recent low-cost, high-efficiency LLM serving solution on TPU for open-source models. Hex-LLM may now be deployed with a single click, on a notebook, or on the playground in Vertex AI Model Garden. Google is eager to learn how your LLM serving routines might benefit from Hex-LLM and Cloud TPUs.
Structure and standards
Inspired by several popular open-source projects, such as vLLM and FlashAttention,Ā Hex-LLMĀ combines the most recent LLM serving technology with custom optimisations made specifically for XLA/TPU.
Hex-LLMās primary optimisations consist of:
For KV caching, the token-based continuous batching approach guarantees the highest possible memory utilisation.
A total overhaul of the PagedAttention kernel with XLA/TPU optimisations.
To efficiently execute big models on several TPU processors, flexible and composable data parallelism and tensor parallelism algorithms with particular weights sharding optimisation are used.
Furthermore, a large variety of well-liked dense and sparseĀ LLM modelsĀ are supported byĀ Hex-LLM, such as:
GemmaĀ 2B and 7B
Gemma 2Ā 9B and 27B
Llama 2Ā 7B, 13B, and 70B
Llama 3Ā 8B and 70B
Mistral 7B and Mixtral 8x7B
Google is dedicated to providingĀ Hex-LLMĀ with the newest and best foundation models along with increasingly sophisticated technology asĀ the LLMĀ area continues to develop.
Hex-LLMĀ offers low latency, high throughput, and competitive performance. The metrics that measured in Googleās benchmark experiments are described as follows:
The average quantity of tokens an LLM server receives each second is measured in TPS (tokens per second). TPS is a more precise way to measure the traffic of an LLM server than QPS (queries per second), which is used to measure the traffic of a generic server.
The amount of tokens the server can produce at a given TPS over a given period of time is measured by throughput. This is a crucial indicator for assessing a systemās capacity to handle several requests at once.
The average time to generate a single output token at a given TPS is measured by latency. This calculates the total amount of time, including queueing and processing time, that is spent on the server side for every request.
Keep in mind that low latency and high throughput are typically mutually exclusive. Throughput and latency should both rise as TPS rises. At a given TPS, the throughput will saturate, but the latency will keep rising as the TPS rises. As a result, Google team may monitor the serverās throughput and latency metrics given a specific TPS. The throughput-latency plot that is produced in relation to various TPS provides a precise assessment of the LLM serverās performance.
A sample of the ShareGPT dataset, a commonly used dataset with prompts and outputs of varying durations, is used to benchmarkĀ Hex-LLM.
The performance ofĀ the Llama 2Ā 70B (int8 weight quantised) and Gemma 7B versions on eight TPU v5e chips is shown in the following charts:
The Gemma 7B model has a maximum TPS of 6250 output tokens per second and a minimum TPS of 6ms per output token.
Llama 2 70B int8 model: at the lowest TPS, 26 ms per output token, and at the highest TPS, 1510 output tokens per second.
Image credit to Google CloudImage credit to Google cloud
Launch Vertex AI Model Garden now
TheĀ Hex-LLMĀ TPU serving container has been incorporated into Vertex AI Model Garden. Through the playground, one-click deployment, or Colab Enterprise Notebook examples for a range of models, users can utilise this serving technology.
Vertex Artificial Intelligence Model, a pre-deployedĀ Vertex AIĀ Prediction endpoint that is incorporated into the user interface is Gardenās playground. After entering the requestās optional arguments and the prompt text and clicking the SUBMIT button, users can rapidly receive the modelās response. Have a go at it with Gemma!
The simplest method for deploying a custom Vertex Prediction endpoint withĀ Hex-LLMĀ is to use the model card UI for one-click deployment:
Go to the page of the model card and select āDEPLOY.ā
Choose the TPU v5e machine type ct5lp-hightpu-*t for deployment for the model variation of interest. To start the deployment process, select āDEPLOYā at the bottom. Two email notifications are available to you: one upon uploading the model and another upon the endpointās readiness.
Users can utilise the Vertex Python SDK to deploy a Vertex Prediction endpoint withĀ Hex-LLMĀ utilising the Colab Enterprise notebook examples for maximum flexibility.
Go to the page of the model card and select āOPEN NOTEBOOK.ā
Pick out the notebook for Vertex Serving. By doing this, the Colab Enterprise notebook will open.
Use the notebook to send prediction queries to the endpoint and deploy usingĀ Hex-LLM.
Users can adjust the deployment in this way to suit their needs the best. For example, they can accommodate a high volume of anticipated traffic by deploying with several clones.
Read more on govindhtech.com
#HexLLM#HighEfficiency#LLMServing#VertexAI#TPU#gpu#AIHypercomputer#LLMmodels#gemma#llm#llama3#Llama2#VertexAIModel#llmmodel#technology#technews#news#govindhtech
0 notes
Text
Fuck it, this is the week I get back on the bandwagon.
The Files:
The Sum Of Our PartsĀ (AFTG, Andriel, Unwind AU,Ā Ch 1 -Ā 9 on AO3Ā here)
Time And Hearts Will Wear Us Thin (hanahaki deconstrucion fic)Ā (ST, Queerplatonic Stobin, Ch 1 -Ā 8Ā on AO3Ā here)Ā
No Easy Peacetime Girl Here To Be FoundĀ (ST, Barb is assumed dead until El rejoins the Hawkins Crew in S2, heavy canon divergence spiraling from pre-S3, Ch 1 -Ā 6Ā on AO3Ā here)
For Thereās No Guarantee That Weāll Ever Come HomeĀ (ST, Barb Lives AU branching off after Ch 5 ofĀ Easy Peacetime GirlĀ where instead of reuniting with the Hawkins crew at the end of S2 Barb is trapped in the Upside Down until Eddie, Steve, and Robin find themselves stuck there at the end of S4,Ā CH 1 on AO3Ā here)
The Shadow Of Dust(Disconnected Scenes)Ā (Stranger Things, His Dark Materials AU, unpublished + looking destined to be Long.Ā )
God Knows Where I Would Be If You Hadnāt Found MeĀ (QP Stobin Alternate First Meeting, Stancy never happens but Robin befriends Steve in the winter of ā83.
SnippetĀ (FromĀ Easy Peacetime Girl):
The girlāif she was even realāwasnāt anyone from Hawkins. Wasnāt any out of town visitor at the wrong place at the wrong time. She was there, out of nowhere, and then she wasnāt. Like magic. Like exactly the kind of secret scientific bullshit that prompts monsters to snatch unsuspecting teenagers out of Nowhere, America towns. And she was so small, and scaredāBarb sincerely doubts that sheās a threat to any missing townspeople. So she doesnāt mention her. Either they know about her, or they donāt, but they wonāt learn more about her from Barb. Not that it stops Brenner from pushing. He seems to have a bee in his bonnet about it, the idea that someone else should already be living there. Not a creature, but a human. Something intelligent.
WIP Wednesday Game
Itās WIP Wednesday, time for a little accountability, sharing your work, and getting a kick in the pants.
Hereās how it works:
In a reblog of this post (so people can find you in the notes) or new thread (w/ rules attached) if you want to play on your own, post up to five (5) filenames of your WIPs; not titles, file names.
Post a snippet from one of them. Snippet must be words you wrote in the last 7 days. Weāre posting progress here. If you havenāt made any, go make some and come back to play!
After youāve posted, people can send you an ask with one of your file names. You must then write 3 sentences in that file. If the filename is one you can't share from (for example, an event or gift fic), write 3 sentences on it anyway, and then 3 more on another to share.
Thatās it! You can invite others to join in, or just post. Iāll be searching the reblogs to find people to send asks to!
If youāre reading this, youāre invited!
If you see someone posting a WIP Wednesday Game snippet, send them an ask! Make them write.
Requested/Friend event mentions under the cut! If you'd like to be pinged next week, send me a message to ask!
Friends @fiore-della-valle @redbirdblogs @greenbergsays @idkfandomwhatever @luckyspike
@obaewankenope @mad-madam-m @anonymousdandelion @geometricfractal @prettybirdy979
@eriquin | Requests @aparticularbandit @madnessfromthemountains @makeroftherunes @1attheedge
@whimsicalmeerkat @kidsomeday @lizhly-writes @skyderman @adhdavinci
@owlbearwrites @anachronismstellar @anyctibius @rilannon @lazinesswrites
@zyrafowe-sny @dreaminghour @blue-eyedbeta @candyskiez @dreamerking27
@kalira @virgulesmith @i-want-delfeur @selkies-world @exceedinglygayotter
@oitreewrites
#wip wednesday#WIP Tags:#the sum of our parts#time and hearts will wear us thin#no easy peacetime girl here to be found#for there's no guarantee that we'll ever come home#the shadow of dust#if you hadn't found me#missed a few weeks because my stepmother had one of her semi-annual breakdowns and I spent almost all of January watching kids#I'm still watching kids but things have calmed down somewhat and I'd like to get back into writing regularly#I'll clear the old asks from my inbox first
127 notes
Ā·
View notes