Technical Challenges associated with record linkage

27 mins 56 secs,  106.88 MB,  iPod Video  480x270,  29.97 fps,  44100 Hz,  522.38 kbits/sec
Share this media item:
Embed this media item:


About this item
Image inherited from collection
Description: Boyd, J
Tuesday 13th September 2016 - 10:00 to 10:30
 
Created: 2016-09-15 16:05
Collection: Data Linkage and Anonymisation
Publisher: Isaac Newton Institute
Copyright: Boyd, J
Language: eng (English)
Distribution: World     (downloadable)
Explicit content: No
Aspect Ratio: 16:9
Screencast: No
Bumper: UCS Default
Trailer: UCS Default
 
Abstract: Background: The task of record linkage is increasingly being undertaken by dedicated record linkage units with secure environments and specialised linkage personnel. In addition to the complexity of undertaking record linkage, these units face additional technical challenges in providing record linkage ‘as a service’. The extent of this functionality, and approaches to solving these issues has had little focus in record linkage literature.

Methods: This session identifies and discusses the range of functions that are required or undertaken in the provision of record linkage services. These include managing routine, on-going linkage; storing and handling changing data; handling different linkage scenarios; accommodating ever increasing datasets. Current linkage methods also include analysis of data attributes such as data completeness, consistency, constancy and field discriminating power. This information is used to develop appropriate linkage strategies.

Results: In order to maximise matching quality and efficiency, linkage systems must address real-world operational requirements to manage linked data over time. By maintaining a full history of links, and storing pairwise information, many of the challenges around handling ‘open’ records, and providing automated managed extractions are solved. Automation of linkage processes (including clerical processes) is another way of ensuring consistency of results and scalability of service. Several of these solutions have been implemented as part of developments by the PHRN Centre for Data Linkage in Australia.

Conclusions: Increasing demand for and complexity of, linkage services present challenges to linkage units as they seek to offer accurate and efficient services to government and the research community. Linkage units need to be both flexible and scalable to meet this demand. It is hoped that the solutions presented will help overcome these difficulties.
Available Formats
Format Quality Bitrate Size
MPEG-4 Video 640x360    1.93 Mbits/sec 405.57 MB View Download
WebM 640x360    625.18 kbits/sec 127.91 MB View Download
iPod Video * 480x270    522.38 kbits/sec 106.88 MB View Download
MP3 44100 Hz 249.85 kbits/sec 51.15 MB Listen Download
Auto (Allows browser to choose a format it supports)