Episode 169 - Resumable Incremental Database Integrity Checks

Guy and Eitan discuss the common challenge of long-running database integrity checks (DBCC CHECKDB) and a solution to resolve it, and why do we need integrity checks at all?</p> Relevant links:</p> <ul> <li><a href="https://passdatacommunitysummit.com/">PASS Data Community Summit</a></li> <li><a href="https://eitanblumin.com/2024/10/28/incremental-integrity-check-for-large-databases/"> Incremental Integrity Check for Large Databases - Eitan Blumin's blog</a></li> <li><a href="https://ola.hallengren.com/sql-server-integrity-check.html">SQL Server Integrity Check - by Ola Hallengren</a></li> <li><a href="https://github.com/microsoft/tigertoolbox/blob/master/MaintenanceSolution/5_job_Maintenance.sql"> tigertoolbox/MaintenanceSolution/5_job_Maintenance.sql · microsoft/tigertoolbox</a></li> <li><a href="https://learn.microsoft.com/en-us/sql/relational-databases/system-stored-procedures/sp-can-tlog-be-applied-transact-sql?view=sql-server-ver16"> sp_can_tlog_be_applied (Transact-SQL) - SQL Server | Microsoft Learn</a></li> <li><a href="https://eitanblumin.com/2018/10/28/t-sql-script-to-roll-forward-transaction-log-backups/"> T-SQL Script to Roll Forward Transaction Log Backups - Eitan Blumin's blog</a></li> </ul>

00:32:36

Episode 168 - New data types in SQL Server and a question about index fragmentation

Guy and Eitan discuss some interesting news from Microsoft regarding SQL Server, and also about the right way to handle index fragmentation.</p> Relevant links:</p> <ul> <li>Resources from Microsoft: <ul> <li><a href="https://techcommunity.microsoft.com/t5/azure-sql-blog/preview-release-of-sdk-style-sql-projects-in-visual-studio-2022/ba-p/4240616"> Preview release of SDK-style SQL projects in Visual Studio 2022 - Microsoft Community Hub</a></li> <li><a href="https://techcommunity.microsoft.com/t5/azure-sql-blog/native-json-support-now-in-preview-in-azure-sql-managed-instance/ba-p/4241273"> Native JSON support now in preview in Azure SQL Managed Instance - Microsoft Community Hub</a></li> <li><a href="https://devblogs.microsoft.com/azure-sql/eap-for-vector-support-refresh-introducing-vector-type/"> EAP for Vector Support Refresh - Introducing Vector type - Azure SQL Devs’ Corner (microsoft.com)</a></li> <li><a href="https://learn.microsoft.com/en-us/shows/azure-friday/calling-external-rest-endpoints-from-azure-sql-database"> Calling external REST endpoints from Azure SQL Database | Microsoft Learn</a></li> </ul> </li> <li>Index fragmentation: <ul> <li><a href="https://ola.hallengren.com/">SQL Server Backup, Integrity Check, Index and Statistics Maintenance (hallengren.com)</a></li> <li><a href="https://kendralittle.com/2023/07/17/should-i-do-index-maintenance-azure-sql-managed-instance/"> Should we do index maintenance on an Azure SQL Managed Instance or Azure SQL Database? (kendralittle.com)</a></li> <li><a href="https://www.brentozar.com/archive/2012/08/sql-server-index-fragmentation/"> Stop Worrying About SQL Server Index Fragmentation (brentozar.com)</a></li> <li><a href="https://erikdarling.com/because-your-index-maintenance-script-is-measuring-the-wrong-thing/"> Why SQL Server Index Fragmentation Isn’t A Problem On Modern Storage Hardware – Darling Data (erikdarling.com)</a></li> </ul> </li> <li>Index fragmentation scripts: <ul> <li><a href="https://github.com/MadeiraData/microsoft-dbas-club/blob/master/Indexes/Table%20and%20Index%20High%20Unused%20Space.sql"> microsoft-dbas-club/Indexes/Table and Index High Unused Space.sql at MadeiraData/microsoft-dbas-club</a></li> <li><a href="https://gist.github.com/EitanBlumin/4fb686ffa07c6f4fd96595f01ec2f1dd"> Check Index Fragmentation Based on Page Fullness and Fill Factor</a></li> </ul> </li> <li>Upcoming webinar at the Cloud Data Driven Meetup: <ul> <li><a href="https://www.meetup.com/cloud-data-driven/events/303173348/">Database DevOps for Leaders - Eitan Blumin, Thu, Oct 24, 2024, 12:00 PM | Meetup</a></li> </ul> </li> </ul>

00:32:49

Episode 167 - Let's Troubleshoot SQL AG Synchronization Latency

Fair warning for all listeners!</p> Before starting to listen to this podcast, very strongly recommended:</p> Have the diagram at the bottom of this page ready in front of you, so that it'll be easier for you to follow along:</p> <ul> <li><a href="https://techcommunity.microsoft.com/t5/sql-server-support-blog/common-causes-and-troubleshooting-solutions-for-sql-ag-data/ba-p/2963083"> Common Causes and Troubleshooting Solutions for SQL AG Data Synchronization Latency - Microsoft Community Hub</a></li> </ul> (sorry in advance!)</p> Additional relevant links:</p> <ul> <li><a href="https://www.red-gate.com/simple-talk/featured/index-cleanup-harder-than-it-looks/"> Index cleanup : Harder than it looks - Simple Talk (red-gate.com)</a></li> <li><a href="https://github.com/chadbaldwin/SQL/blob/main/Scripts/Find%20Overlapping%20Indexes.sql"> Find Overlapping Indexes.sql at chadbaldwin/SQL (github.com)</a></li> </ul>

00:37:40

Episode 166 - DR Planning for SQL Server and Loading Large CSV Files

Guy and Eitan discuss the recent CrowdStrike incident and what it would mean for DBAs, and discuss options to load huge CSV files into SQL Server as fast as possible.</p> Relevant links:</p> <ul> <li><a href="https://techcommunity.microsoft.com/t5/sql-server-support-blog/101-of-troubleshooting-sql-server-on-linux/ba-p/4195732"> 101 of Troubleshooting SQL Server on Linux - Microsoft Community Hub</a></li> <li><a href="https://learn.microsoft.com/en-us/sql/tools/bcp-utility?view=sql-server-ver16&tabs=windows"> bcp utility - SQL Server | Microsoft Learn</a></li> <li><a href="https://www.mssqltips.com/sqlservertip/4359/altering-lock-escalation-for-sql-server-tables/"> Altering lock escalation for SQL Server tables (mssqltips.com)</a></li> <li><a href="https://docs.dbatools.io/Import-DbaCsv">dbatools docs | Import-DbaCsv</a></li> <li><a href="https://medium.com/@sasha.korovkina2003/a-fast-way-to-load-large-csv-files-into-microsoft-sql-server-64f37b5eeab2"> A Fast Way to Load Large CSV Files into Microsoft SQL Server | by Sasha Korovkina</a></li> </ul>

00:35:32

Episode 165 - News in Azure SQL and Woes of Excel

Guy and Eitan discuss some important and interesting news from Microsoft about SQL Server, Straight Path Solutions publish 30 articles about SQL Server security checks, Guy talks about his experience with Excel, and Eitan is irritated about people <em>still</em> not doing SQL jobs correctly in AlwaysOn Availability Groups.</p> Relevant links:</p> <ul> <li><a href="https://www.youtube.com/@SQLBits/videos">SQLBits Free Videos - YouTube</a></li> <li><a href="https://learn.microsoft.com/en-us/sql/t-sql/data-types/json-data-type?view=azuresqldb-current"> JSON data type (preview) - SQL Server | Microsoft Learn</a></li> <li><a href="https://techcommunity.microsoft.com/t5/azure-sql-blog/efficient-time-based-audit-log-filtering-for-azure-sql-database/ba-p/4167136"> Efficient Time-Based Audit Log Filtering for Azure SQL Database - Microsoft Community Hub</a></li> <li><a href="https://techcommunity.microsoft.com/t5/azure-sql-blog/announcing-unistr-and-operator-in-azure-sql-database-preview/ba-p/4157714"> UNISTR and ANSI SQL concatenation operator (||) (microsoft.com)</a></li> <li><a href="https://techcommunity.microsoft.com/t5/sql-server-blog/sql-server-on-azure-vms-i-o-analysis-preview/ba-p/4158572"> SQL Server on Azure VMs: I/O analysis (preview) - Microsoft Community Hub</a></li> <li><a href="https://www.microsoft.com/en-us/sql-server/blog/2024/07/03/announcing-the-retirement-of-sql-server-stretch-database/"> Announcing the retirement of SQL Server Stretch Database - Microsoft SQL Server Blog</a></li> <li><a href="https://straightpathsql.com/archives/tag/30-sql-server-security-checks-in-30-days/"> 30 SQL Server Security Checks in 30 Days Archives - Straight Path Solutions</a></li> <li><a href="https://learn.microsoft.com/en-us/sql/relational-databases/tables/use-sparse-columns?view=sql-server-ver16"> Use Sparse Columns - SQL Server | Microsoft Learn</a></li> <li><a href="https://git.madeiradata.com/mssql-jobs-hadr/availability-groups/">SQL Server Jobs & AlwaysOn Interoperability | HADRMyJobs</a></li> </ul>

00:38:44

Episode 164 - The Good the Bad and the Ugly Transactional Replication

Guy and Eitan continue discussing HADR solutions. But this time focusing on Transactional Replication, its cons and pros and potential use cases.</p> Also, some important announcements from Microsoft about Azure SQL!</p> Relevant links:</p> <ul> <li><a href="https://devblogs.microsoft.com/azure-sql/data-api-builder-ga/">Data API builder General Availability (microsoft.com)</a></li> <li><a href="https://www.mssqltips.com/sqlservertip/8011/build-rest-api-with-azure-data-api-builder-dab/"> Build REST API with Azure Data API Builder (DAB) (mssqltips.com)</a></li> <li><a href="https://techcommunity.microsoft.com/t5/azure-sql-blog/announcing-mirroring-azure-sql-database-in-fabric-for-public/ba-p/4085988"> Zero ETL, Near-real time replication, Mirroring Azure SQL Databases in Fabric (microsoft.com)</a></li> <li><a href="https://devblogs.microsoft.com/azure-sql/announcing-eap-native-vector-support-in-azure-sql-database/"> Announcing EAP for Vector Support in Azure SQL Database - Azure SQL Devs’ Corner (microsoft.com)</a></li> <li><a href="https://techcommunity.microsoft.com/t5/azure-sql-blog/update-policy-for-azure-sql-managed-instance/ba-p/4148968"> Update Policy for Azure SQL Managed Instance - Microsoft Community Hub</a></li> <li><a href="https://learn.microsoft.com/en-us/sql/relational-databases/replication/transactional/transactional-replication?view=sql-server-ver16"> Transactional Replication - SQL Server | Microsoft Learn</a></li> <li><a href="https://github.com/MadeiraData/ReplicationManagementMechanism">MadeiraData/ReplicationManagementMechanism: Use SQL Server database tables to manage and configure Transactional Replication, and set it up easily between publishers and subscribers using stored procedures (github.com)</a></li> </ul>

00:35:32

Episode 163 - When and Why to HADR

Guy and Eitan discuss the various High Availability and Disaster Recovery options available to us in Microsoft SQL Server, their main advantages, limitations, and when it's most suitable to use or not to use them.</p> Relevant links for further reading:</p> <ul> <li><a href="https://learn.microsoft.com/en-us/sql/database-engine/availability-groups/windows/basic-availability-groups-always-on-availability-groups" rel="noopener" target="_blank">AlwaysOn Basic Availability Groups / Database Mirroring</a></li> <li><a href="https://learn.microsoft.com/en-us/sql/database-engine/availability-groups/windows/overview-of-always-on-availability-groups-sql-server" rel="noopener" target="_blank">AlwaysOn "Enterprize" Availability Groups</a></li> <li><a href="https://learn.microsoft.com/en-us/sql/sql-server/failover-clusters/windows/always-on-failover-cluster-instances-sql-server" rel="noopener" target="_blank">Failover Cluster Instance</a></li> <li><a href="https://learn.microsoft.com/en-us/sql/database-engine/log-shipping/about-log-shipping-sql-server" rel="noopener" target="_blank">Log Shipping</a></li> <li><a href="https://learn.microsoft.com/en-us/sql/relational-databases/replication/transactional/transactional-replication" rel="noopener" target="_blank">Transactional Replication</a></li> </ul>

00:34:37

Episode 162 - Backups and Recovery, RTO, RPO, and RCO

Guy and Eitan talk about some interesting news from Microsoft about SQL Server in Azure.</p> And also discuss the topic of Backups and Recovery, RTO, RPO, RCO, and database Integrity Checks.</p> Relevant links:</p> <ul> <li><a href="https://techcommunity.microsoft.com/t5/azure-sql-blog/microsoft-copilot-in-azure-extends-capabilities-to-azure-sql/ba-p/4075408"> Microsoft Copilot in Azure extends capabilities to Azure SQL Database (Private Preview) - Microsoft Community Hub</a></li> <li><a href="https://techcommunity.microsoft.com/t5/azure-sql-blog/introducing-regular-expression-regex-support-in-azure-sql-db/ba-p/4072741"> Regex in SQL DB (microsoft.com)</a></li> <li><a href="https://techcommunity.microsoft.com/t5/modernization-best-practices-and/sql-server-regular-expressions-library-sample/ba-p/3101875"> SQL Server Regular Expressions Library Sample - Microsoft Community Hub</a></li> <li><a href="https://learn.microsoft.com/en-us/sql/t-sql/functions/string-split-transact-sql?view=sql-server-ver16"> STRING_SPLIT (Transact-SQL) - SQL Server | Microsoft Learn</a></li> <li><a href="https://www.madeiradata.com/post/do-you-have-a-proper-backup-strategy"> Do You Have a Proper Backup Strategy? (madeiradata.com)</a></li> <li><a href="https://www.sqlskills.com/blogs/paul/checkdb-from-every-angle-consistency-checking-options-for-a-vldb/"> CHECKDB From Every Angle: Consistency Checking Options for a VLDB - Paul S. Randal (sqlskills.com)</a></li> <li><a href="https://www.brentozar.com/archive/2012/02/where-run-dbcc-on-alwayson-availability-groups/"> Where to Run DBCC on Always On Availability Groups - Brent Ozar Unlimited®</a></li> </ul>  </p> Also, check out our previous episode, if you haven't yet:</p> <a href="https://sqlserverradio.com/episode-161-exclusive-announcing-the-biggest-innovation-for-azure-sql-managed-instances-codename-hermes"> SQL Server Radio: Episode 161 - EXCLUSIVE: Announcing the Biggest Innovation for Azure SQL Managed Instances (Codename: Hermes)</a></p>

00:35:55

Episode 161 - EXCLUSIVE: Announcing the Biggest Innovation for Azure SQL Managed Instances (Codename: Hermes)

Niko Neugebauer and Vladimir Ivanovic are our esteemed guests for today, and they have a HUGE announcement to make about Azure SQL Managed Instances.</p> Extra! Extra! 🗞 Hear all about it on this exclusive scoop here at the SQL Server Radio podcast!</p> Relevant links:</p> <ul type="disc"> <li><a href="https://techcommunity.microsoft.com/t5/azure-sql-blog/introducing-azure-sql-managed-instance-next-gen-gp/ba-p/4092647"> Azure SQL Managed Instance Next-gen GP (microsoft.com)</a></li> <li><a href="https://learn.microsoft.com/en-gb/azure/azure-sql/managed-instance/service-tiers-next-gen-general-purpose-use?view=azuresql"> Use Next-gen General Purpose service tier - Azure SQL Managed Instance | Microsoft Learn</a></li> <li><a href="https://learn.microsoft.com/en-us/azure/azure-sql/managed-instance/free-offer?view=azuresql"> Try for free (preview) - Azure SQL Managed Instance | Microsoft Learn</a></li> <li><a href="https://www.youtube.com/watch?v=0vko71WnfTU">Next-gen General Purpose service tier brings 500 user dbs, improved storage and more to Azure #SQLMI (youtube.com)</a> (2 min video)</li> </ul>

00:41:51

Episode 160 - OPTION RECOMPILE and the magical Turbo button

Guy tries to convince Eitan that OPTION(RECOMPILE) is the ultimate "Turbo" button in SQL Server, and that it's strongly underappreciated.</p> Relevant links for more info:</p> <ul> <li><a href="https://learn.microsoft.com/en-us/sql/t-sql/queries/hints-transact-sql-query?view=sql-server-ver16#recompile"> OPTION(RECOMPILE) (Transact-SQL) - SQL Server | Microsoft Learn</a></li> <li><a href="https://learn.microsoft.com/en-us/sql/relational-databases/stored-procedures/recompile-a-stored-procedure?view=sql-server-ver16"> Recompile a Stored Procedure - SQL Server | Microsoft Learn</a></li> <li><a href="https://www.sqlservercentral.com/blogs/should-i-use-optionrecompile"> Should I use option(recompile)? – SQLServerCentral</a></li> <li><a href="https://blog.sqlauthority.com/2019/12/31/sql-server-parameter-sniffing-and-option-recompile/"> SQL SERVER - Parameter Sniffing and OPTION (RECOMPILE) - SQL Authority with Pinal Dave</a></li> </ul>

00:32:49