MicrosoftDocs/architecture-center/docs/databases

Last 20 commits touching this section.

e9be916

PNP Edit: [New] Cache-aside caching with Azure Managed Redis and Azure Database for PostgreSQL - ph4 (#16786) * Add cache-aside architecture for PostgreSQL Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 55e34426-91ef-457f-9867-47a2261581bc * Apply suggestions from code review Co-authored-by: learn-build-service-prod-10[bot] <274431553+learn-build-service-prod-10[bot]@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: learn-build-service-prod-10[bot] <274431553+learn-build-service-prod-10[bot]@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Chad Kittel <chad.kittel@gmail.com> * Added price calculator estimate Added information on using the Azure pricing calculator for cost estimation. * Revise cache-aside architecture documentation Updated the cache-aside architecture documentation to clarify use cases, reliability considerations, and security measures, including cache invalidation and dependency resilience. * Apply suggestions from code review Co-authored-by: learn-build-service-prod-05[bot] <274429479+learn-build-service-prod-05[bot]@users.noreply.github.com> * Minor formatting before any reviews * Apply batched suggestions from code review Co-authored-by: Chad Kittel <chad.kittel@gmail.com> * Update cache-aside architecture diagram Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 55e34426-91ef-457f-9867-47a2261581bc * Update cache-aside browse thumbnail Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 55e34426-91ef-457f-9867-47a2261581bc * Update cache key guidelines in documentation + VNet add Clarified the description of cache key values in the documentation and add Vnet to components list * Refine PostgreSQL and Redis monitoring guidance Removed redundant PostgreSQL Query Store recommendations and streamlined monitoring suggestions. * Enhance cache-aside pattern documentation for Redis and PostgreSQL Updated the cache-aside pattern explanation to include handling of cache fill failures and logging. Added emphasis on controlled write paths for cache invalidation. * in process * in process * edits * edits * peer review etc. * Update docs/databases/architecture/cache-aside-azure-managed-redis-postgresql-content.md --------- Co-authored-by: Phil <philip.laussermair@redis.com> Co-authored-by: learn-build-service-prod-10[bot] <274431553+learn-build-service-prod-10[bot]@users.noreply.github.com> Co-authored-by: Chad Kittel <chad.kittel@gmail.com> Co-authored-by: learn-build-service-prod-05[bot] <274429479+learn-build-service-prod-05[bot]@users.noreply.github.com> Copilot-Session: 55e34426-91ef-457f-9867-47a2261581bc

978a720

Reassign articles after org changes (#16843) * switch to clayton * Switch priyanka

5c0bdda

PnP edit: Event-driven cache updates with Azure Managed Redis and Azure Cosmos DB (#16830) * Add event-driven cache architecture Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: ca656736-4805-47e4-95f4-db3579d4dd29 * Add saved pricing estimate Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: ca656736-4805-47e4-95f4-db3579d4dd29 * Apply batched suggestions from code review Co-authored-by: learn-build-service-prod-07[bot] <274430390+learn-build-service-prod-07[bot]@users.noreply.github.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * Enhance documentation on cache updates and versioning Clarify handling of cache-miss fills and change feed updates, emphasizing the importance of versioning and tombstones in Redis. Provide rules for atomic operations to avoid race conditions. * Revise soft-delete handling with versioned tombstones Updated the process for handling soft-deletes in Azure Cosmos DB and Redis, introducing versioned tombstones to prevent older values from being repopulated. * Update docs/databases/architecture/event-driven-cache-updates-azure-managed-redis-cosmos-db-content.md Co-authored-by: learn-build-service-prod-06[bot] <274430002+learn-build-service-prod-06[bot]@users.noreply.github.com> * Revise Redis update process and TTL handling Updated the process for Redis updates to include atomic updates and versioned tombstones. Clarified the handling of cache values and TTL in relation to failed updates. * Update guidance on source versioning for cache management Clarify the handling of source versions and tombstones in cache updates. * Apply batched suggestions from code review Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> Co-authored-by: learn-build-service-prod-05[bot] <274429479+learn-build-service-prod-05[bot]@users.noreply.github.com> * Revise documentation for Azure services and caching patterns Updated links to Azure documentation for clarity and accuracy. Added details about Microsoft Entra authentication for Azure Managed Redis and logging best practices. * Enhance TTL strategy for Redis and source items Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * Apply batched suggestions from code review Co-authored-by: Chad Kittel <chad.kittel@gmail.com> * Update event-driven cache diagram Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: ca656736-4805-47e4-95f4-db3579d4dd29 * Add Azure Virtual Network details to architecture doc * Clarify tombstone update in diagram Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: ca656736-4805-47e4-95f4-db3579d4dd29 * Apply batched suggestions from code review Co-authored-by: Justine Cocchi <justine@cocchi.org> * Update cache update guidelines in documentation Removed recommendation to reuse long-lived Redis and Azure Cosmos DB clients. * Update dependency resilience section for clarity Clarify handling of Redis unavailability and Azure Cosmos DB throttling in the event-driven cache update process. * Refine documentation on change feed modes and processing Clarified the explanation of the latest version change feed mode and its implications for handling deletes. Updated the requirements for the Azure Functions trigger regarding the all versions and deletes change feed mode. * Update event-driven cache update guidelines for Azure Clarified handling of soft-deletes and TTL policies for Redis and Azure Cosmos DB. Enhanced guidance on versioning and authentication practices. * Refine cache update strategies and monitoring details Updated metrics and error handling strategies for Redis and Azure Cosmos DB integration. Enhanced logging and monitoring practices for cache operations. * Apply suggestion from @ckittel * Continue work from PR 16582 by doing a P4 edit * Fix link * Align Functions and App Service in diagram; do peer review edits: correct typo * Address review comments: revert diagram, remove Azure Managed, implement Copilot suggestion --------- Co-authored-by: Phil <philip.laussermair@redis.com> Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Co-authored-by: learn-build-service-prod-07[bot] <274430390+learn-build-service-prod-07[bot]@users.noreply.github.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> Co-authored-by: learn-build-service-prod-06[bot] <274430002+learn-build-service-prod-06[bot]@users.noreply.github.com> Co-authored-by: learn-build-service-prod-05[bot] <274429479+learn-build-service-prod-05[bot]@users.noreply.github.com> Co-authored-by: Chad Kittel <chad.kittel@gmail.com> Co-authored-by: Justine Cocchi <justine@cocchi.org> Copilot-Session: ca656736-4805-47e4-95f4-db3579d4dd29

198624c

Link Azure Managed Redis components to the WAF service guide (#16838) * Initial plan * Update Azure Managed Redis component links Co-authored-by: ckittel <671075+ckittel@users.noreply.github.com> --------- Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: ckittel <671075+ckittel@users.noreply.github.com>

7571ef9

PnP edit: Materialized View pattern (#16739) * first draft * Potential fix for pull request finding Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * Address materialized view review feedback * Address remaining materialized view feedback * Minor tweaks before review * Apply batched suggestions from code review Co-authored-by: Chad Kittel <chad.kittel@gmail.com> * Apply batched suggestions from code review Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * Restore cross-partition Materialized View example * convert to md only * links * edits * edit * edit * remove file accidentally added * edits --------- Co-authored-by: Anastasia Harris <61602255+anaharris-ms@users.noreply.github.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> Co-authored-by: Chad Kittel <chad.kittel@gmail.com>

ff15941

Use lightboxes where it helps (#16737) Aligns image lightbox usage with the width of the image a reader opens (threshold: strictly greater than 688 pixels). Removes lightbox attributes from 21 images at or below the threshold and adds one lightbox attribute to an image above it. Co-authored-by: azure-patterns-practices-assistant[bot] <316226753+azure-patterns-practices-assistant[bot]@users.noreply.github.com> Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

453ddbe

fix typo

15cfa4c

Convert icons to :::image

65d8f63

PnP edit: Modern data warehouse medallion architecture in Microsoft Fabric (#16618) * Revise dataops-mdw-content for Modern data Warehouse on Microsoft Fabric Updated the article to provide a comprehensive overview of the Modern Data Warehouse architecture on Microsoft Fabric, including key components, data flow, and best practices for implementation. * Revise medallion architecture documentation for Fabric Updated the documentation for the medallion architecture in Fabric Data Warehouse, including sections on data flow, layers, and implementation guidance. * Add files via upload * Revise image link and enhance contributors section Updated image link and added contributors section with next steps and related resources. * Add files via upload * Add files via upload Added new png file * Fix broken Markdown image link on line 22 * Restored original content and updated image reference in docs/databases/architecture/dataops-mdw-content.md * Merge dataops-mdw-content.md from prabhkaur1977-MDW-on-Fabric to main * Delete unsupported .pptx diagram file from _images * Fix invalid file link to data-warehouse.yml * Update dataops-mdw.yml * Resolving build warnings * Revise AKS hybrid date and add AKS Edge Essentials details Updated the date for AKS hybrid and added details for AKS Edge Essentials, including scenarios and considerations. * Update author title for Prabhjot Kaur * Delete docs/databases/architecture/_images/modern-data-warehouse-microsoft-fabric.png deleted file modern-data-warehouse-microsoft-fabric.png * Add files via upload added file in main branch * Expand architecture section with alternatives and scenarios Added alternatives for data architecture and considerations for various workloads. * Update dataops-mdw-content.md with medallion architecture changes - Add title heading - Fix image path - Condense Well-Architected considerations - Remove Alternatives and Scenario overview sections - Fix relative link to data-warehouse.yml * Fix image filename for architecture diagram Updated the architecture diagram image filename for clarity. * Delete docs/operator-guides/aks/choose-kubernetes-edge-compute-option.md Removed choose-kubernetes-edge-compute-option.md file. * Revise section titles for data flow and components Updated section titles and improved clarity on data flow and components in the medallion architecture. * Expand architecture documentation with alternatives and scenarios Added alternatives for data architecture approaches and clarified scenarios where the current architecture may not be suitable. * Enhance DataOps documentation with key considerations Added considerations for reliability, security, cost optimization, operational excellence, and performance efficiency in the DataOps architecture documentation. * Revise dataops-mdw-content for medallion architecture Updated the content to provide a comprehensive overview of the medallion architecture using Fabric Data Warehouse, detailing its components, layers, and best practices for data ingestion, cleansing, and analytics. * Revise medallion architecture content and Bronze layer details Updated the description of the medallion architecture and clarified the focus on SQL-based development. Adjusted the Bronze layer details to emphasize raw data ingestion methods and removed redundant content. * Updating title per Prabhjot * Add files via upload * Adjusting heading levels Updated section headers and improved formatting for clarity in the DataOps MDW content. * formatting changes before next steps * Apply suggestions from code review Co-authored-by: learn-build-service-prod-07[bot] <274430390+learn-build-service-prod-07[bot]@users.noreply.github.com> * Address final review feedback Clarify Fabric streaming, capacity, reliability, and Materialized Lake View guidance, and apply the requested documentation style improvements. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Minor edits before review * A few more * Apply suggestions from code review Co-authored-by: learn-build-service-prod-04[bot] <274428985+learn-build-service-prod-04[bot]@users.noreply.github.com> * Fix broken link * Address architecture review feedback Clarify the SQL-first Fabric warehouse pattern, align the article with the Architecture Center template, and update the diagram and metadata to match the documented flow. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Chad Kittel <chad.kittel@gmail.com> * Add design guidance introduction Add context below the Design guidance heading so the section isn't empty before its first subsection. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Update contributor title Update Prabhjot Kaur's contributor role to Senior Cloud Solution Architect. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Add architecture pricing estimate Link the saved Azure Pricing Calculator estimate for the SQL-first Fabric warehouse architecture. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Update docs/databases/architecture/dataops-mdw-content.md * Align MDW data flow text and diagram - Sync data flow steps with updated diagram labels and paths - Update bronze guidance wording for mirroring and pipeline ingestion - Replace MDW architecture image with latest revised diagram Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Potential fix for pull request finding Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * Apply suggestion from @ckittel * Apply suggestions from code review Co-authored-by: Chad Kittel <chad.kittel@gmail.com> * Update thumbnail to match current architecture diagram * edits * edits * edits --------- Co-authored-by: Prabh <48260128+prabhkaur1977@users.noreply.github.com> Co-authored-by: Prabh <prkau@microsoft.com> Co-authored-by: Shannon Leavitt <47186198+ShannonLeavitt@users.noreply.github.com> Co-authored-by: Chad Kittel <chad.kittel@gmail.com> Co-authored-by: learn-build-service-prod-07[bot] <274430390+learn-build-service-prod-07[bot]@users.noreply.github.com> Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Co-authored-by: learn-build-service-prod-04[bot] <274428985+learn-build-service-prod-04[bot]@users.noreply.github.com> Co-authored-by: Stephen Sumner <109609721+stephen-sumner@users.noreply.github.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

0dfe987

PNP Edit: [AAC] Maintenance - Hybrid-ARB | Update Azure Hybrid Options + Getting Started articles (#16585) * Azure hybrid options - Complete article rewrite * Address hybrid options review feedback * Address hybrid architecture review comments * add spacing for clarity when reading * Reduce bullet spacing * updated spacing * Clarify disconnected operations eligibility * Refresh hybrid getting started guide Convert the hybrid Getting Started article to the YAML-plus-content pattern, move conceptual guidance and its diagram from Azure hybrid options, add browse metadata and a thumbnail, update navigation and inbound references, and keep detailed selection criteria in the options article. * Improve hybrid options workload flow Frame specialized service evaluation as the next step after selecting workload placement, infrastructure, and connectivity, and broaden the heading to reflect the services covered. * Fix hybrid getting started title Use singular architecture consistently in the YAML metadata and remove the duplicate H1 from the included Markdown body. * Address hybrid options review comments Add Azure Local operating limits and preview status, include Azure Arc-enabled Kubernetes in the decision-tree description, and preserve the intentional contributor attribution. * Update hybrid technology choices overview * Update technology choices review date * Clarify hybrid control plane options * Restore technology choices review date * Restore hybrid guide Markdown format Keep the Getting Started Architecture Guide as a standalone Markdown article, remove the YAML wrapper and its browse thumbnail, and update inbound links. * Clarify Azure IoT Operations offline limit Update the hybrid services diagram and accessible description to distinguish Azure Local disconnected operations from Azure IoT Operations' 72-hour offline window. Remove the redundant diagram footer. * Refine hybrid services diagram Replace the hybrid services diagram to keep Azure IoT Operations in the Edge and IoT category, clarify the Azure Local service list, and synchronize the accessible description. * Correct hybrid decision tree label Change the connected Azure Local path from "control plan" to "control plane" in the SVG and matching browse thumbnail. * Clarify Azure Local outage impact Document immediate cloud-dependent feature limitations, the 30-day reduced-functionality threshold, and AKS certificate-expiration risk during Azure connectivity loss. * Scope Azure Local sync guidance Qualify the documented 30-day synchronization and reduced-functionality behavior as applying to hyperconverged Azure Local deployments. * Apply suggestions from code review Co-authored-by: Chad Kittel <chad.kittel@gmail.com> * Update images * Address hybrid architecture review feedback Incorporate reviewer guidance on portability, edge AI, workload placement, recovery objectives, service wording, preview usage, and contributors. * Refine Azure Local reliability link text * Update hybrid options article date * improvements for Resiliency and recovery * Clarify hybrid deployment and connectivity guidance Correct Azure Local deployment taxonomy, distinguish ExpressRoute from VPN Gateway connectivity, and restore the overview article freshness date. * Update hybrid connectivity diagram label Rename the decision-tree branch to “Connectivity to Azure services” and refresh the matching browse thumbnail. * Clarify failover testing cadence Base Azure Local test-failover frequency on workload criticality, recovery objectives, business and compliance requirements, and material changes instead of a universal monthly interval. * Apply suggestion from @ckittel * Reference Sovereign Private Cloud in hybrid guidance * update ms.date * Reorder hybrid candidate approaches * Restore technology choices review date * Add private access selection guidance * Clarify Azure Arc machine support * Clarify VPN wording from review 5083098602 Addresses feedback from https://github.com/MicrosoftDocs/architecture-center-pr/pull/16383#pullrequestreview-5083098602 by distinguishing ExpressRoute from an encrypted site-to-site VPN in the article diagram and synchronized browse thumbnail. * get started article * options * edits * edits * edits * copilot * edits * not a tree * rearrange to fit template * Revert last 2 commits * revert toc * peer review cx * make png 3-2 * Apply batched suggestions from code review Co-authored-by: Chad Kittel <chad.kittel@gmail.com> * Fix link Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * . * . * . * fix --------- Co-authored-by: Neil Bird <nebird@microsoft.com> Co-authored-by: Chad Kittel <chad.kittel@gmail.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

5d8fc86

Fix indentation

8031fcb

Updates

7180c48

Fix redirected links in 4 Oracle/Cosmos DB articles Replace /azure/cloud-adoption-framework/scenarios/oracle-iaas/ links with the current /azure/cloud-adoption-framework/scenarios/oracle-on-azure/ path, and fix the redirected Entra fundamentals link, so readers reach each page in one hop. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

51ca5ef

Apply batched suggestions from code review Co-authored-by: learn-build-service-prod-05[bot] <274429479+learn-build-service-prod-05[bot]@users.noreply.github.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

2f52031

Fix redirected and broken links in database guide articles Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

44678a0

Apply batched suggestions from code review Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> Co-authored-by: Chad Kittel <chad.kittel@gmail.com>

a38c130

Fix embedded links in 2 database articles - Resolve redirects to their final destinations - Fix a broken anchor by pointing to the section's new location Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

5723236

[learn-link-doctor] Improve embedded links in 4 article(s) (#16546) * Fix broken and redirected links in 4 Data Factory articles Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Apply batched suggestions from code review Co-authored-by: learn-build-service-prod-01[bot] <274427437+learn-build-service-prod-01[bot]@users.noreply.github.com> --------- Co-authored-by: azure-patterns-practices-assistant[bot] <316226753+azure-patterns-practices-assistant[bot]@users.noreply.github.com> Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Co-authored-by: Chad Kittel <chad.kittel@gmail.com> Co-authored-by: learn-build-service-prod-01[bot] <274427437+learn-build-service-prod-01[bot]@users.noreply.github.com>

0f4f855

Merge pull request #16469 from MicrosoftDocs/copilot/github-sample-catalog-fix-unhealthy-links Remove links to archived Azure-Samples/modern-data-warehouse-dataops repository

7d0ac99

Recommend Databricks in-platform audit logging instead of default Log Analytics export Co-authored-by: ckittel <671075+ckittel@users.noreply.github.com>