#Blob Storage

[msicc]

#CASBAN6 – How to create a facade to manage Azure Blob Storage with Azure Functions

I just blogged: #CASBAN6 – How to create a facade to manage Azure Blob Storage with Azure Functions #Azure #AzureFunctions #AzureDev #AzureBlob #Blob #Storage #API #dotNET #csharp #OpenAPI #Swagger #security

Why the facade? You might wonder why I am creating this facade to manage file uploads to the Azure Blob Storage. There are two main reasons. The first one is that I wanted to have a common endpoint for all interactions with Azure, also for file handling. The second one is security. The function app already has a high level of security by enforcing a Microsoft account, which is equally needed for…

[mytechnoinfo]

Unlock the potential of Azure storage solutions by comparing Data Lake Gen2 and Blob Storage. Discover their unique capabilities, such as hierarchical namespaces, scalability, durability, and security, to harness the full benefits for your data analytics needs.

[hattiestgal]

About bloatware with BUBBLEGUM... What would happen if you unzipped a multi-terabye zip bomb?

Since I'm away from my PC and this fell out of the doodle game submission window (which I'll clear up now, will just be on the fridays I open them up!), I'll describe it for now!

I imagine at first, not much would happen, BUBBLGUM might slow down just a little bit as she optimizes herself to move that much data all at once, only to soon reach the complete slowdown of her systems as TUMM does its thing to account for the now terabytes of data getting fed into the machines storage all at once. It wouldn't be a fast process either... I don't know if it would be better for most of the sensors that allow BUBBLGUM to perceive the outside world to be on or off while the process is happening, but by the end of it, this gel liner has pushed the HIFLEX abdomen to its limits, spilling out and rolling over itself in all directions, likely taking up a room of space in the process.

[varpusvaras]

Because I'm a curious bee about other people's answers I'm gonna give mine as well for the two truths and one lie @cookiemonsterv3 @starrrgazingbunny

Number 3 is a lie, I've been on newspapers multiple times (two times front cover girl lmao) and I "technically" have 15 kids. They're just very little and not born yet. They're my little freezer nuggets aksdkkksl.

[belligerentbagel]

#I blame calarts #not the school really. but an unfortunate side effect of the application process #calarts requires your 'sketchbook' to be kind of an art piece #as per tradition people post videos of their calarts sketchbooks whether its accepted or rejected #but since we live in Video Media Land now those videos get really popular. cause they're cool and pretty! #but now there's tons of videos all over instagram of people trying to meet this presentable standard #and it's lead to people thinking that's what ALL sketchbooks should look like (x)

"It took me TWO years to finish this sketch book!" Well that's cuz you're not fuckin sketching. Those are fully painted pieces dawg that's a renderedbook. I've gone through four sketchbooks in my off time this year alone I just draw stupid faces and shit for fun. pussy up like the rest of us and start drawing stick figures with guns

[donaldjreynolds]

[step2gen]

In today's data-driven world, effective data storage and management is a major concern for businesses of all sizes. Traditional storage solutions can be expensive, cumbersome, and often fail to meet the growing data needs of modern organizations. This is where cloud storage services like Azure Blob Storage come into play, providing a scalable, secure, and cost-effective solution for data storage needs. Read more..

[kariniai]

Karini AI Unlocking Potential: Strategic Connectivity with Azure and Google

Generative AI is a once-in-a-generation technology, and every enterprise is in a race to embrace it to improve internal productivity across IT, engineering, finance, and HR, as well as improve product experience for external customers. Model providers are steadily improving their performance with the launch of Claude3 by Anthropic and Gemini by Google, which boast on par or better performance than Open AI’s GPT4. However, these models need enterprise context to provide quality task-specific responses. Over 80% of large enterprises utilize more than one cloud, dispersing enterprise data across multiple cloud storages. Enterprises struggle to build meaningful Gen AI applications for Retrieval Augmented Generation (RAG) with disparate datasets for quality responses.

At the launch, Karini.ai provided connectors for Amazon S3, Amazon S3 with Manifest, and Websites to crawl any website, but it had the vision to provide coverage for 70+ connectors. We are proud to launch support of additional fully featured connectors for Azure Blob Storage ,Google Cloud Storage(GCS) , Google Drive , Confluence, and Dropbox . The connectors provide an easier way to ingest data from disparate data sources with just a few clicks and build a unified interactive Generative AI application. All the connectors are fully featured:

Karini.ai includes an nifty feature called which allows the connectors to gauge the volume of source datasets and file types before executing the ingest.

Perform full initial load and subsequently perform incremental ingest, aka Change Data Capture (CDC)

Filter the source connectors using regular expressions for selective ingest. For example, to ingest only PDF files, use filter as (*.pdf)

Recursive search capabilities are available to search all child directories and subsequent directories.

With the addition of Google, Azure, Confluence, and Dropbox connectors, Karini.ai enables enterprises to unlock the true potential of Generative AI. Our comprehensive collection of connectors tackles the challenge of siloed data, allowing the creation of powerful RAG applications that leverage data from across various sources. This streamlines development and improves data quality, ultimately delivering superior GenAI experiences for internal and external users.

Karini.ai remains committed to expanding its connector ecosystem, fostering a future where Generative AI seamlessly integrates with the ever-evolving enterprise data landscape.

Build your Generative AI application today! Leverage these enterprise connectors and unify disparate cloud-based sources. With Karini.ai, you can unlock the true potential of Generative AI, streamline development, improve data quality, and deliver superior GenAI experiences.

About Karini AI:

Fueled by innovation, we're making the dream of robust Generative AI systems a reality. No longer confined to specialists, Karini.ai empowers non-experts to participate actively in building/testing/deploying Generative AI applications. As the world's first GenAIOps platform, we've democratized GenAI, empowering people to bring their ideas to life – all in one evolutionary platform.

Contact:

Jerome Mendell

(404) 891-0255

sales@karini.ai

[techdirectarchive]

How to Install Azure Storage Explorer on Windows

[amalgjose]

How to Enable or Disable public access of an Azure Blob Storage (Storage Account) using Python Program ?

Azure storage account has a property in the networking section to enable or disable public access. This option is available directly on the web portal. There are options to whitelist a specific VNet or specific IP addresses. In some scenarios, we may get some requirement to enable access to some sources which does not have a static public IP address. In this scenario, the easiest option we have…

[msicc]

#CASBAN6: How to configure Azurite to use DefaultAzureCredential with Docker on macOS

I just blogged: #CASBAN6: How to configure Azurite to use DefaultAzureCredential with Docker on macOS #Azurite #Azure #AzureStorage #Docker #macOS #AzureSDK

Before we will have a look at the promised facade for uploading files to Azure’s Blob storage, I want to show you how to configure Azurite to use the Microsoft Identity framework with Docker on macOS for local debugging. Using the Identity framework, our local debug environment and the productive rolled out functions will behave the same. If you have been following along, you should already have…

[rajaniesh]

Microsoft Azure Backup Options: Which One Fits Your Needs Best?

Microsoft Azure offers a range of services and solutions for various scenarios and needs. One of the essential aspects of any cloud service is the ability to back up and restore data and applications in case of any failure, disaster, or human error. Azure

[mycloudrevolution]

Veeam Azure Object Storage Automation

Veeam Azure Object Storage Automation #Veeam #VeeamVanguard #Azure

During my prior blog post, I had the requirement to spin up a lot of Azure Object Storage Repositories. As is usually the case, this quickly led me to Veeam Azure Object Storage Automation. I am pretty new to Azure automation, so this was an exciting topic. Please feel free to reach out if you are more experienced in Azure automation and see some enhancement opportunities. Before starting my…

[stefanoscloud]

Azure storage design considerations

Introduction

When planning for the deployment or migration to any Azure storage type, there are a number of design factors to take into account. The current post lists Azure Storage design considerations and can be used as a design guide by Azure architects and pre-sales engineers when designing Azure storage solutions.

Azure storage account types

The first step of your Azure storage design considerations when choosing storage for your solution, is to review your infrastructure and application requirements and choose the proper storage types. Azure offers the following storage types as of late February 2023. Azure storage account types - Blob (using containers) - Azure files (SMB file shares) - Table - Queue For more details on the available relational and non-relational data types in Azure, refer to the Azure DP-900 certification exam curriculum at: https://stefanos.cloud/blog/microsoft-dp-900-certification-exam-study-guide/.

Performance options

When provisioning a new Azure storage account, the following general options are available for performance. This setting cannot be changed after storage account creation. - Standard (general purpose V2) - Premium (for low latency scenarios)

Security options

The following security options can be set for any Azure storage account. - Require secure transfer for REST API operations - Allow enabling public access on containers. Blob containers, by default, do not permit public access to their content. This setting allows authorized users to selectively enable public access on specific containers. You can use Azure policy to audit this setting or prevent this setting from being enabled. - Enable storage account key access - Default to Azure Active Directory authorization in the Azure portal - Minimum TLS version - Permitted scope for copy operations

Access tiers

The following access tiers are available and only applicable to blob data: - Hot (online) - Cool (online) - Archive (offline). The archive access tier is not an available option during storage account resource creation. The archive tier is an offline tier for storing data that is rarely accessed. The archive access tier has the lowest storage cost. However, this tier has higher data retrieval costs with a higher latency as compared to the hot and cool tiers.

Region and zone placement

In some cases, a storage account can be provisioned at an Azure Edge zone. More information about Azure public multi-access edge compute (MEC) can be found at https://azure.microsoft.com/en-us/solutions/public-multi-access-edge-compute-mec/#overview.

Redundancy options

Redundancy relates to the way each storage account is being synced to other Azure zones and regions to achieve high availability. The following Azure storage redundancy options are available. - LRS. Locally-redundant storage. Suitable for non-critical scenarios. - GRS. Geo-redundant storage. Recommended for backup scenarios. - ZRS. Zone-redundant storage. Recommended for high availability scenarios. - GZRS. Geo-zone redundant storage. Includes the offerings and benefits of both GRS and ZRS. - RA-GRS. This option is a variation of the GRS option with the addition of the "Make read access to data available in the event of regional unavailability" option. - RA-GZRS. This option is a variation of the GZRS option with the addition of the "Make read access to data available in the event of regional unavailability" option. Depending on your chosen redundancy option, you shall have different options available under the Data Management --> Redundancy blade of the storage account in the Azure portal, as shown in the example below.

Network connectivity and network routing options

The following network connectivity and network routing options are available for Azure storage accounts. - Network connectivity. You can connect to your storage account either publicly, via public IP addresses or service endpoints, or privately, using a private endpoint. - Network routing. Determine how to route your traffic as it travels from the source to its Azure endpoint. Microsoft network routing is recommended for most customers.

Data protection

The following data protection options can be configured for an Azure storage account. Recovery Point-in-time restore and hierarchical namespace cannot be enabled simultaneously. Also versioning and hierarchical namespace cannot be enabled simultaneously. When point-in-time restore is enabled, versioning, blob change feed and blob soft delete are also enabled. The retention periods for each of these features must be greater than that of point-in-time restore, if applicable. Tracking Access control

Encryption options

The following encryption options can be used for any Azure account.

Other Azure storage configuration options

The following additional options can be set during Azure storage account creation. There are dependencies between various options, in that some options cannot be enabled if a combination of other options is selected. - Enable hierarchical namespace. The Data Lake Storage Gen2 hierarchical namespace accelerates big data analytics workloads and enables file-level access control lists (ACLs). - Enable SFTP. Requires hierarchical namespace. - Enable network file system v3. Enables the Network File System Protocol for your storage account that allows users to share files across a network. This option must be set during storage account creation. - Allow cross-tenant replication. Cross-tenant replication and hierarchical namespace cannot be enabled simultaneously. Allow object replication to copy blobs to a destination account on a different Azure Active Directory (Azure AD) tenant. Not enabling cross-tenant replication will limit object replication within the same Azure AD tenant. - Enable large file shares. Provides file share support up to a maximum of 100 TiB. Large file share storage accounts do not have the ability to convert to geo-redundant storage offerings and upgrade is permanent. This option cannot be changed after storage account creation.

External access options

The "Networking" blade in the Azure portal provides the following options for connecting to an Azure storage account. Public network access This decides whether public access will be enabled or not and if yes, from which networks and IP addresses. If no, access to the storage account will only be available via private endpoint connections (maximum security). Resource instances and network routing This decides which Azure resource types will have access to the storage account and how traffic will be routed from the external endpoint to the Azure storage account. The "Access Keys", "Shared Access Signature (SAS)" and "Lifecycle management" blades in the Azure portal dictate how external access will be provisioned and how Azure storage account data will be preserved or disposed of, as per predefined policy metrics. Access keys and corresponding connection strings A shared access signature (SAS) is a URI that grants restricted access rights to Azure Storage resources. You can provide a shared access signature to clients who should not be trusted with your storage account key but whom you wish to delegate access to certain storage account resources. By distributing a shared access signature URI to these clients, you grant them access to a resource for a specified period of time. An account-level SAS can delegate access to multiple storage services (i.e. blob, file, queue, table). Note that stored access policies are currently not supported for an account-level SAS. Shared Access Signature (SAS) options include connection string, SAS token and SAS URL for each of the available storage types (blog, file, table, queue)

Data migration options

There are a variety of Azure data transfer solutions available for customers. In the Azure portal under the "Data Migration" blade, select the resource type and transfer scenario, based on which the Azure portal wizard will guide you to the solution that best fits your scenario. Please note that the data transfer rate you observe is impacted by the size and number of files in the transfer, as well as your infrastructure performance and network utilization by other applications. An example of the data migration wizard is shown below. The most notable tools for migrating data to Azure storage accounts are the following: - Azure AzCopy - Azure Powershell - Azure CLI - Azure Data Factory - Azure Storage in the Azure portal - Azure Storage Explorer - Azure Storage REST API/SDK - Azure Data Box - Azure Data Box Disk - Azure File Sync Read the full article

[flamingpudding]

Part 11 of Ghost Kid in Gotham

>>Masterpost >>AO3

<<1 Previous Next

One Step Closer

Casandra stared at the child hiding in the antic behind storage boxes. Her siblings were out on patrol and Bruce practically had to drag Damian out on it for once. She could see how their youngest was reluctant to leave his twin.

She couldn't say she understood but from his body language Cass could clearly see what she was able to understand. Damian was protective, worried, scared and loved. It wasn't much different from what he felt towards the rest of them yet it was highly amplified and not as subtitle as he usually made it seem.

It worried her. Should anything happen to Danny it would greatly hurt her youngest brother. That was why she had stayed back to help Alfred and Duke to look after their newest brother while everyone went out. Steph had wanted to stay too but Cass saw it and pushed her girlfriend towards the cave, shaking her head. Maybe next time.

Steph had too much energy and was too excited to stay with Danny. Damian probably knew it too. He had scowled when the louder ones of their siblings tried to volunteer. But Cass? She had seen it. Danny had stiffed once the child realized Damian was going to leave him for a short time.

Confused, protective, scared, defensive, worried.

She had wanted to tell their father to not force Damian on patrol, even if he had skipped it a lot lately in favor of staying with his twin. But when Alfred and Duke approached the boy as chosen watcher, he had calmed. He was still scared and defensive but also curious and nervous now.

Still she had stayed behind. Danny had still been scared and defensive.

Her worry was proven correct when not even after three minutes into the others leaving the little boy disappeared from their side. Danny was silent and knew what openings to use to slip away. But the way she didn't even sense it felt like more than just the league's training. It was like the little guy blinked out of existence. Duke had instantly used his ghost vision only to curse when he ran into a wall, again apparently.

Alfred had seemed rather amused and only gave them a knowing and amused smile. If Alfred wasn't panicked then Casandra wouldn't be either. The butler knew, so Danny wasn't in danger.

Still it had taken her some time and she was ready to call everyone back to help in the search for her newest brother but then she had seen him. It was only from the corner of her eye and once again Danny was very silent and didn't even make a single sound. She could have imagined seeing him but Cassandra trusted her instincts now.

Which led her to the current situation. She blinked as she moved to sit cross legged with a little distance in front of the child. Blue eyes were clearly watching her the moment she had entered his field of vision.

Defensive, scared, worried.

Smiling, she didn't move any closer at first. There was a green blob, a blob ghost according to her brothers, floating close to the child and some snacks laying around the boy, discarded wrapping papers and a stolen plate of Alfred's cookies. So that was why the butler had been amused, he knew Danny had taken them. A giggle wanted to bubble out but she suppressed it, opting to smile fondly.

"Cookies good?"

Her newest brother only tilted his head in confusion. She inched a little closer, stopping when Danny started to hiss slightly.

Defensive, protective, scared, confused.

Once the child stopped hissing she tried again, this time pointing at the cookie in Danny's hand. "Good?"

Defensive, confusion, realization.

Danny with wary eyes kept watching her as he broke the cookie in two and offered one half to the green blob that ate the piece in one go while Danny nibbled on it. His blue glowing eyes never left her. The boy continued eating the cookies like that, always sharing with that green blob while also keeping an eye on her.

Cass could only smile as she just sat there in silence. She had remembered to send Duke a text that she had found Danny but with that text she had also asked him to not come up here. There was no reason to unsettle her newest brother any more than needed.

Besides, she counted it as a win for her when after a while of silently enjoying each other's company and respecting Danny's boundaries, the boy himself slowly crawled closer to her. He wasn't touching her but he slid half a cookie over to Cass.

She wished she had taken a video of this. Just so that she could prove that Cass officially had one over her brothers now, except for Damian of course. Danny was close to her, not hissing and sharing one of the cookies the little biter had stolen. She would hold this over Dick for a long time.

Meanwhile in Amity Park…

"Where is the twerp?"

Suppressing a scream, Jazz whirled around and came face to face with Dan who stood behind her with his arms crossed in front of his chest. Glowing red eyes were glaring unblinkingly at her. It would be off putting if Jazz didn't know that there was an undertone of worry. She was alone and hadn't expected any of the others involved in the search to show up. Tucker and Sam were in school keeping up appearances and Ellie was following a ghost rumor two cities over to the west of Amity park.

Jazz looked over the other, taking in how unaffected the near mirror image of her brother looked. Dan had been mostly spared from the fallout in Amity, considering that he lived 90 percent of the time with Vlad with the other 10% spent in the ghost zone making friends with Fright Knight again and so far Dan had also avoided meeting their parents. Vlad, him and Ellie had been the last to hear of Danny's disappearance let alone his death announcement of their parents or rather from the GIW. It had been a month since that announcement and Jazz was honestly surprised that Dan hadn't shown up earlier. But Vlad had pulled back from Amity and who knew when their parents had informed him about Danny's 'death' if at all and the other man had only found out because he decided to visit now of all times.

Eitherway, the future version of her brother / time clone / cousin / second brother was now standing before her. "I know the twerp is not dead yet. And the old man is trying to get as much information out of Maddie and Jack as he can right now. So I decided to get information from you shits."

"Language Dan." Jazz corrected out of habit. She was amazed that Dan even found them but again Danny probably knew about this hidden room of Sam's Mansion, which they were now using as their debriefing room. Maps were laying everywhere as well as pinned to the walls. Some were marked red, places Ellie had already looked into and hadn't found any sign of Danny.

"We have been looking into a lot of towns with reported ghost sightings to try and find him but a lot of them came up with nothing. All fake with no real ghost appearances. Danny isn't dead, we know this because Ellie told us that the Ghost Zone would riot if he were, so-"

"Oh they wouldn't just be rioting. If humans killed or incapacitated the king this entire dimension would be done and over." Wasn't that reassuring to know, Jazz thought, her parents weren't just neglecting and too obsessed in their research. No, they and the GIW could be the cause of their entire Dimension dying if they ever got their hands on Danny again.

"The Fenton portal is closed, right? And I have asked Fright Knight to not let anyone slip through the old man's portal until I am back at the castle." Dan wasn't looking at her anymore but to the side a scowl clearly visible on his face. That was another mystery to Jazz, the Fenton portal one day shortly after Danny's disappearance and right before the death announcement stopped working. It just suddenly closed and no matter what her parents did, did not open again. "Don't know how long we can keep ghost idiots, that also want to go look for the twerp, in check. So you better hurry up and find him."

"Thank you, Dan." Jazz smiled fondly at her time double brother who only scowled and refused to make eye contact with her. "I am sure we will find Danny."

"Tried the Booo-merang, yet?" The other only muttered, but he did glance at Jazz from the corner of his eyes.

Jazz let out a sigh, remembering how throwing that thing was one of the first things she did upon returning from college and hearing about Danny's disappearance. "We did but it only flew a couple of meters before falling to the ground. Tucker is tinkering with it, thinking that Danny might just be out of range for it."

She heard an inaudible grumble from the other and smiled sadly. The Booo-merang had always been a sure fire way to find Danny but now even that wasn't working for them. Sam was convinced that they must have brought Danny to another GIW-facility far away from Amity before or after they announced his disappearance, but Tucker refuted this with what he found when he hacked into them. But what he found made Tucker think that Danny might have initiated one of their backup plans, the fact that the Fenton portal was no longer working spoke for it but that the emergency kit they had prepared for this was still untouched spoke against it. Ellie hadn't said anything on that matter but Jazz knew the little girl was very worried, going so far to travel to every city ghost rumors appear in hopes that it's Danny they were talking about.

And now even Dan and Vlad seemed like they were starting to get involved.

A sigh escaped her once more as she turned around and looked sadly down at the map on the table. "Danny will… is… has to be on the run. Tucker doesn't think the GIW have him anymore. He had hacked into their database and nothing indicated that they still have him. But from what he found Danny must be heavily injured to the point , Tucker… he… he has seen pictures he refused to share. According to what he found from them, Danny just disappeared with injuries that would make escaping without help difficult, yet no one knows where he is."

"The twerp will be okay. Little shit is tougher than he looks. I should know that the best." Dan muttered and Jazz smiled saddly at the way the other attempted to comfort her. Then she noticed how Dan was eyeing a world map that was pinned to the wall, his red eyes strangely focused differently than they were before. Like he was remembering a long forgotten memory.

"Dan?"

"You remember, I… we… he…" Glowing red eyes closed in frustration before they looked back at Jazz. She knew that the other sometimes still had a hard time putting a line between Danny and himself, especially when it came to certain things like memories and everything before the split of their timelines. "Danny is adopted."

"What does that have to…?"

"You said he just disappeared according to the GIW Database? There might be something more to it. I am going to have to look into some old shit I… we, fuck, Danny probably hasn't thought about for years now."

Stunned Jazz watched how Dan changed into his ghost form that looked so different from Danny's, the form that used to scare her and hadn't changed much since he gained a human body. The ghost looked ready to fly away.

"Wait, Dan where are you going?!" She tried to stop him but just like her Danny when he got an impulsive idea, Dan wasn't going to listen. Instead the other only turned to her with a grim face.

"If you come across the old man, tell him I am going to look into an old asshole. There are a handful of people involved with me… fuck I mean him that could make the twerp disappear without a trace. These fuckers are worse then the GIW and we certainly don't need them getting involved now. As if killing us once wasn't enough…"

Jazz watched helplessly how Dan disappeared through the wall like he had appeared. With a worried look she glanced at the world map Dan had been looking at, unsure of what the other had seen or remembered because of it. Worry heavily stirred inside of her and she wanted to scream loudly infrustration. Once more her brother was keeping her out of the loop about something important and by the quiet mutter at the end she most likely wasn't supposed to hear, she knew it didn't mean anything good.

Once more Jazz sighed, swallowing her frustration and worry to pull out her phone, decided to tell the others with a quick message that Dan was now helping too and apparently following a different lead. A lead that if she interpreted everything Dan had said correctly, had something to do with Danny's life before he had been adopted and was connected to something highly dangerous.

The secure chat exploded with follow up questions, she couldn't answer and only left her to stare at the world map once more in worry and unsure on how to proceed from here.