Instructor

Yanghua Xiao, shawyh@fudan.edu.cn

Office: 217-3, Software Building, Zhangjiang Branch

Goals

To study the internals of database systems as an introduction to research and as a basis for rational performance tuning.

The study of internals will concern topics at the intersection of database system, operating system, and distributed computing research and development. Specific to databases is the support of the notion of transaction: a multi-step atomic unit of work that must appear to execute in isolation and in an all-or-nothing manner. The theory and practice of transaction processing is the problem of making this happen efficiently and reliably.

Tuning is the activity of making your database system run faster. The capable tuner must understand the internals and externals of a database system well enough to understand what could be affecting the performance of a database application. We will see that interactions between different levels of the system, e.g., index design and concurrency control, are extremely important, so will require a new optic on database management design as well as introduce new research issues. Our discussion of tuning will range from the hardware to conceptual design, touching on operating systems, transactional subcomponents, index selection, query reformulation, normalization decisions, and the comparative advantage of object-oriented database systems. This portion of the course will be heavily sprinkled with case studies from database tuning in biotech, telecommunications, and finance.

Week Subject Literature Material
1 Introduction (RG 1.5-1.8, RG 4.2); SP 1 slides
2 Schema Refinement SP 4; RG 19 slides
3 Data Storage HG 11.1-11.5 slides
4 Storage Refinement SP 2.5, HG 11.6-11.7 slides
5 Disk Organization HG 12 slides
6 Index Tuning-Convential Index HG 13.1-13.2 slides
7 Index Tuning-B+tree RG 10, HG 13.3 slides
8 External Sorting(8.1),Index Tuning-Hash Index(8.2), Index Performance Tuning(8.3) HG13.4,RG 11, SP 3 slides8.1, slides8.2, slides8.3
9 Operator Evaluation RG14 slides
10 Query Optimization RG15 slides
11 NoSQL overview slides, dbtune_project2014.rar, chenyuhong.doc
12 Query Tuning SP 4.6-4.7 slides
13 Overview of Transaction Management(13.1), Lock Tuning(13.2),Log Tuning(13.3),Troubleshooting(13.4),API Tuning(13.5),Buffer management(13.6) HG 16-17, SP 2.2, HG 18, SP 2.3 ,SB 7,SB 5 slides13.1, slides13.2, slides13.3, slides13.4, slides13.5, slides13.6,
14 Homework 1 homework1_research and write.doc
15 Homework 2 homework2_schema design.doc
16 Project 2020 PJ2020.zip