|
Support and Service > F.A.Q > Don't Destroy The Archives
|
|
Don't Destroy
The Archives! This report explains the value of not destroying original recordings once they have been transcribed to digital media. It is shown that there is information in the original master recordings, whether in disc or analogue tape formats, that cannot be recovered with present day technology which would allow a future technology to recover improved quality. By destroying original recordings, the possibility of such future improvements is permanently lost. 1. INTRODUCTION1a. The problem This report is prompted by alarming reports from a number of quarters that, after being archived in a modern digital format, original master recordings in the form of disc or analogue tape are being destroyed. What this article seeks to show is that there is in the original recording information which cannot be recovered with present day technology that will, at a future time with much more powerful signal recovery, storage and processing technology than is presently available, be usable to get much improved quality from the original recording than is currently possible. The very process of transcribing into a current digital format throws away over 99% of this information, which is thereby not available to future technologies. The conclusion is: never throw away a master recording, no matter how low quality it appears to be. 1b. Reasons for destroying masters.The reason why master recordings are destroyed
is a combination of two factors: 1) The storage of master recordings
is often expensive, both in terms of cost of space and manpower, and
of the cost of maintaining optimum storage conditions (temperature,
humidity, etc.). 2) There is a widespread belief, which this article
will show to be wholly unfounded, that modern digital transcription
technology is practically perfect, so that it is wrongly believed that
the digital transcription is virtually as good as the original master.
This belief that modern transcription technology
is practically perfect is not a new one, and there are past awful warnings
about how historical material can be lost. By way of a typical example,
during the 1960's and 1970's, whenever historical 78 rpm material was
remastered onto analogue tape for commercial release by some major record
companies, the original master parts were then destroyed, unknown at
the time to the remastering engineers involved - who of course were
aware of how compromised the transcription was with available technology.
The result is that it is not now possible to remaster to digital from
the original masters, meaning that this material has the extra drop-out,
modulation noise, flutter and other losses inherent in the analogue
tape technology used but not inherent in the original 78 rpm medium.
There are alternatives to destroying the
original masters if the cost of storage is too high. One is to deposit
master recordings into national or charitably funded archive organisations,
such as the National Sound Archives in the UK. The National Sound Archives,
in particular, has a rigorous policy for preventing breaches of copyright
of material in its hands. There is a great deal more information on analogue tape recordings, both reel-to-reel and even cassette, than is recovered on current playback machines. Various technical faults can be identified and removed using this extra information, and we list different aspects that we have been able to identify. 2.1 Wow and FlutterAll analogue tape recordings have wow and
flutter due to speed irregularities in the original recording process,
as well as alterations in the physical dimensions of the tape base and
imperfection in the playback machine. It is surprising to note that
most master tape recordings made during the era of AC bias (i.e. the
vast majority of archive tapes) have on them information that allows
almost complete removal of wow and flutter! Another problem plaguing analogue tape is
print-through, i.e. magnetisation of a layer of tape by adjacent layers
during storage. Again surprisingly, there are methods of greatly reducing
such print-through, which work only if the original tape is available,
in this case making use of the magnetic properties of the tape. It is
generally found that most print-through is due to the existence in the
tape coating of a low-coercivity population of magnetic particles among
the generally much higher coercivity particles that make up most of
the coating. This low-coercivity population is much more easily magnetised
(hence its importance in causing print-through), but is also much more
easily erased. Conventional analogue tape playback uses
a single head to read the whole width of a tape track, but this averages
information across the width of the tape track, thereby losing potentially
useful information obtainable from looking at the way the magnetisation
varies across the width of the track. Phase differences between the subtracks are evidence of azimuth errors, which can thereby be measured and compensated by digital time correction of the individual subtracks before adding them to get the original sound. Additionally, it is possible to compensate for departures from a straight line profile for the original record head (e.g. due to head wear or contamination). Such azimuth correction can be dynamic and fast in operation, so can compensate for example for the common problem of rapid periodic azimuth variations due for example to warping of the tape due to pressure on the tape spool. 2.3.2 Dynamic drop-out correctionTape dropouts in general will not be uniform across the width of a track, and by comparing levels on the subtracks, and finding that subtrack with the highest wanted signal level and the relative gains of the other subtracks, it is possible to determine (if desired even as a function of frequency) the degree of gain loss individually on each of the subtracks. In the absence of dropout, the optimum sound would simply be the sum of the subtracks, but a weighted sum (using a so-called "Weiner filtering" weighting), with overall gain determined by the level from the highest subtrack level, will allow not only compensation for dropout, but the best possible S/N in the recovered signal on a moment by moment basis. 2.3.3 Dynamic lateral head adjustmentIf many subtracks are used, the process described in the last paragraph also has the automatic effect of dynamically compensating for misadjustments of track placement across the width of the tape, thereby ensuring optimum adjustment of the effective positioning of the playback head on a moment by moment basis. 2.3.4 Crosstalk reductionMoreover, by appropriate "deconvolution" of the magnetic profile across the width of the tape, such effects as "bleed" between adjacent tape tracks can be reduced, thereby reducing crosstalk both between the tracks and between a track and the unwanted noise from guardbands between the tracks. In some cases, such guardbands may contain spurious signals due to imperfect tape erasure or to magnetisation of the tape before recording. 2.3.5 Modulation noise reductionA particular benefit of the track splitting
approach is that the difference signal between subtracks contains information
about the tape noise without the signal. This allows recovery not only
of the steady background noise spectrum from the track differences,
but also of modulation noise, i.e. variations of noise with the wanted
signal. In section 2.2 above, we suggested the use
of an erase head on the opposite side of the tape from the playback
head. It is also possible to recover additional information from a master
tape by using a separate playback head on both sides of the tape. A
playback head on the "wrong" side of the tape is of course
spaced away from the wanted tape layer, causing a severe loss of high
frequencies, but future head technology may reduce the resulting h.f.
S/N penalties, at least up to middle audio frequencies. Conventional tape playback heads only "read" magnetisation in one direction relative to the motion of the tape, essentially a transversal component along tape surface. However, if in addition, magnetisation perpendicular to the tape surface is read, this provides additional means of separating the wanted signal from spurious signals, and also of separating out various modulation noise and distortion components. In particular, it is known that print-through from each side of the tape has a distinctive magnetisation angle relative to the tape surface, and again this can be used to reduce print-through by taking appropriate linear combinations of the transversal and the perpendicular magnetisation component. The required head technologies may, for example, be based on the Hall effect.. 2.6 Analysing the bias signalThe AC bias signal recorded on the tape (see
section 2.1) may contain extra information allowing playback with reduced
distortion. The recorded AC bias frequency, and its harmonics, will
be modulated, both in amplitude and phase by information related to
the original signal. With further understanding of the distortion mechanisms
in AC biasing, it may prove possible to use this additional information,
along with nonlinear signal processing, to recover a less distorted
version of the wanted signal than can be recovered by direct playback
on its own. As in section 2.1, this requires a much wider bandwidth
than the normal audio band. The above methods can be combined, although
the practical problems of devising a double-sided head divided into
say 100 subtracks, each responsive to transversal and perpendicular
magnetisation, responding up to say 500 kHz with audio-grade quality
and good S/N are formidable by present-day standards! The problem of recovering all information
from recordings mastered, for example, in a 78 rpm grooved format is
in its own way as formidable as the tape case above, although as we
shall note, some past signal recovery technologies have already used
information thrown away by digital transcription! 78 rpm records typically have serious problems from what is often termed "scratch" noise, which is a noise consisting of a large number of added impulses. The first process to detect and suppress such impulses was implemented at EMI in the late 1940's, and various analogue processes were subsequently developed by the present writer with Peter Craven in the early 1970's and commercially by Packburn, and currently, digital processes using more sophisticated predictor-type impulse detection and interpolation type replacement have been devised by CEDAR and by NO-NOISE. 3.1a Ultrasonic componentsHowever, such processes inevitably damage
the integrity of the original signal, resulting in a less clean sound,
and it is an important aim to minimise such damage. In separating the
impulses from the music signal, it is found important to preserve a
very wide bandwidth, preferably more than 40 kHz, since the duration
of an impulse is inversely proportional to the bandwidth, so that short
impulses will only occur for wide bandwidths. Also, there is a relative
lack of music-related signal energy above say 15 kHz, so that the location
of impulses can much more easily be determined in the ultrasonic region
above 15 kHz - indeed the EMI process in the 1940's remarkably used
the ultrasonic components to localise the impulses in time. A second piece of information that allows
improved separation of impulses from the wanted signal, used both by
the author's early work with Craven, and by Packburn, used the fact
that record grooves have two walls, and the signals for each wall can
be separately recovered using a stereo pick-up. It is generally found
that most impulses occur either on one groove wall or the other, so
that on mono records. the impulse alone can be recovered by taking the
difference of the two wall signals. In practice, this "vertical"
difference signal is contaminated by various distortions, but the use
of two channels of recovered information nevertheless allows much more
reliable detection of impulses. Nevertheless, if from a mono 78 rpm record one can recover both groove walls separately with a bandwidth of 50 kHz or more, the resulting information can be processed much more reliably to remove impulse noise with minimal distortion of the wanted signal. This relies on using specialised digital recording technology, as the standard stereo digital formats have inadequate bandwidth. The DSP processing to make optimum use of the extra information has not yet been developed, but could be near-future technology were there to be a demand for it (e.g. by a major record company commissioning the development of such a system from one of the existing specialist suppliers such as CEDAR or NO-NOISE). 3.2 Tracing DistortionThe ideal playback stylus would recover information
from a point or line contact with each groove wall, but actual styli
have a finite radius of contact in the direction of travel of the groove.
This radius of contact causes what is termed "tracing distortion",
whose theory was well developed by Shiga, Cooper and others in the 1960's.
As first noted in 1975 by the writer, tracing distortion has the effect
not only of adding nonlinear distortion to the wanted signal, but it
also has the effect of prolonging the duration of unwanted noise impulses,
thereby increasing impulse noise. Therefore, optimum recovery of the
signal to reduce impulse noise requires the use of a stylus with as
small a contact minor radius as possible. There is far more information that in principle
can be recovered from an original disc or metal parts. Ideally, one
would aim not simply to recover a kind of "average" of the
signal on each groove wall over the contact area of a stylus, but to
record separately the signal at each different height up the groove
wall, so as to recover the complete profile of the cross section of
the groove at each point along the groove. Besides the obvious geometric parameters
for the groove surface, both metal parts and actual records have numerous
other mechanical, chemical and physical parameters such as stress, elasticity,
coefficient of friction and so forth. Each of these may provide additional
information allowing deduction of distortions in the reproduced sound
and permitting correction of the distortions. It is difficult to predict
what parameters may be found useful in future, but they can clearly
only be recovered from the original records or masters. In addition to measuring information about the groove walls and the playback velocity, other information that may allow improved signal recovery includes: 1) playback of the "land" between the grooves, since this may correlate with noises in the groove itself 2) playback of the bottom of the groove, for similar reasons, and 3) measurement of the precise physical relationship between adjacent grooves (including distance and timing relationships), both to help reduce pre- and post-echo effects (the disc equivalent of print-though) and to detect periodic disturbances that may be filtered out by appropriate long-term comb-filter averaging. 3.6 Information contentThe information recoverable from original
disc masters involves data rates of the order of 50 times greater than
that of a conventional digital audio channel, due to the extra audio
bandwidth, use of stereo channels, and the use of extra subchannels
to record groove profile and (where relevant) elasticity information.
As in the analogue tape case, this requires more powerful recording
media (here a digital video recorder would have an adequate data rate),
much more DSP power than is currently used to process the data to recover
a signal, and finally the use of multiple playback of the source master
with careful measurement of all relevant physical parameters. While the above processing possibilities
are most apt to masters of the recordings, similar techniques could
be applied to first generation copies when these are all that are available.
While the loss of information in the original copying process cannot
be undone, at least one will in future be able to reduce the effect
of imperfections in the medium onto which the copy is made. The improvements
that this will give will still be very worthwhile from a quality viewpoint.
Besides the problems of recovering all relevant
information from the original master, there is also the problem of imperfections
in the transcription medium. The naivete of the early days of digital
audio when it was thought to be essentially "perfect" has
recently been replaced by an understanding of many of the mechanisms
by which the ears hear faults that, according to traditional audio measurements
were negligibly small. This work, based on the researches of Louis Fielder
at Dolby Labs and Bob Stuart of Meridian Audio in modelling of masking
in auditory perception, shows that there are still significant audible
faults especially in available analogue-to-digital converters (ADCs).
This should not be a surprise, since such faults are heard not only
by many audio professionals, but even by many lay listeners who hear
a distinctive loss in digital transcriptions. This report has shown that current digital
transcription technology cannot yet recover most of the information
in master disc or analogue tape recordings, and that future technologies
will allow the recovery of extra information from the original master
that cannot be recovered from a digital transcription. We have described
improvements that we expect will become possible with future transcription
technologies, although some of these may still be some time away due
to limitations in current technologies. |
|
All content copyright
© 1999 by Waves
LTD. All rights reserved
|