Testing 1130 MRAM board - defect in design identified

LOCATION ZERO IS SET TO VALUE OF ZERO DURING A SYSTEM RESET

I saw two categories of problems while testing the memory board, now that I have the system power more reliable (but not still fully fixed). First, when more than a few bits are set to 1 values, the data does not seem to be reliably read back into the Storage Buffer Register (SBR). Second, many times when I hold down the Reset button (or at power on reset), the contents of location zero is set to all zero bits. 

I dug into the timing of various signals when the machine comes out of reset and to find vulnerabilities that will result in a spurious write being commanded of the MRAM chip. The logic for controlling the lines +Storage Use, +Storage Select, +Storage Write and +Storage Read produce unexpected values as a reset condition is release, which triggers my board to perform a write operation. 

+Storage Use will be on at any time except for a storage cycle when the 1130 does not want to access memory, thus it is on immediately as reset is released. +Storage Write is on immediately after reset is released and also during the entire time that reset is active. 

It is even possible that this flaw in the design could cause problems at other times while the system is running, but in any case it must be corrected. 

REFINING THE USE OF CONTROL SIGNALS BY MY BOARD

In systems using the faster 2.2 microsecond core memory type, the signal +Storage Select will emit a short pulse when the processor steps into states T0, X0, T4 or X4, which will trigger a storage cycle as long as +Storage Use is also high. In normal processor execution, each storage cycle takes eight T clock steps, T0 through T7. The first half of the storage cycle, T0 to T3, is when +Storage Read is high. The last half is when +Storage Write is high. Thus the IBM core memory logic is triggered by the pulse as long as +Storage Use is high, but does a read or a write based on whether +Storage Read or +Storage Write is high. 

In the 3.6 microsecond memory type, such as the machine into which my board will be installed, +Storage Select is driven by the high address bits to select which core memory compartment is active. In the machine I am restoring, there is only one gate so this is effectively always on. In fact, the core memory logic in that compartment does not even look at a +Storage Select signal since memory in gate B compartment C1 is ONLY used with 4K or 8K configurations of 3.6 uS core. 

MAJOR PIVOT IN DESIGN OF THE BOARD

I decided to ditch the timer modules and instead depend on a small FPGA to handle the timing. I designed around the Digilent CMOD S7, a Spartan 7 board. It has enough input-output pins to make the operation of the board fully flexible. I did have to add a 5V power supply regulator to feed the CMOD. 

Now, the pulse to write a 1 into the Storage Buffer Register (SBR) for each of the 16 data and 2 parity bits is an individual line for each bit. Since the existing board works okay for a small number of 1 bits but fails with larger groups like 6 or more, having individual control would allow me to stagger the pulses across the bits so that any funny analog issues that arise from the simultaneous activation are avoided. 

I also control the individual control signals for the MRAM chip - Write, Data Out and Enable - so that I can refine the timing of the activation if needed. Even the buffer chips which block the incoming SBR bits from the memory during reads but pass them through on writes is controlled by the FPGA. 

This definitely requires a change and a new PCB to be fabricated. I also have to write the Verilog for the FPGA, but that is dead simple for this case. While the board is being manufactured, I can write and test the code. Then, when testing, I can adjust timing of signals to refine the behavior of the board.

Slowly improving ability to use LTspice to model circuits with germanium components

WHY MODEL AND HOW

LTspice is a free version of the SPICE circuit modeling software. Entering a schematic allows the operation to be simulated and graphs to be produced of the voltage and current at selected nodes. Very valuable to understand the operation of a circuit in detail. I also find it useful to modify components to see how they would behave if they are defective, in order to confirm a hypothesis about which part has failed. 

The libraries provided by Analog Devices when you download LTspice include many component, but not every possible part. Usually the Spice model for a component can be found online and added to your schematic. However, there are almost no models online for Germanium transistors and diodes.

IBM USED GERMANIUM SEMICONDUCTORS IN THE SMS AND SLT PRODUCT FAMILIES

Standard Modular System (SMS) was the basis for IBM's transistorized computers in the 1950s and early 1960s. Solid Logic Technology (SLT) as the basis for the 1960s and 1970s computers such as S/360 and 1130. The diodes and transistors used in both families were Germanium based. 

While the industry was transitioning to Silicon semiconductors which are much better for most purposes, IBM needed massive quantities of transistors and diodes, including manufacturing their own. Staying with Germanium assured them of adequate supply and avoided the need to re-engineer many circuits. Similarly the industry was beginning to use integrated circuits (ICs) in the 1960s but IBM's volume needs and other factors led them to stay with discrete transistors and diodes in the SLT generation. 

IBM used many different transistor types in their products in SMS. In SLT, the transistors and diodes used in the SLT modules were much more standardized but SLT cards often included separate transistors in a myriad of types. 

SPICE MODELS FOR GERMANIUM SEMICONDUCTOR COMPONENTS

There are only a handful of models to be found on the Internet for Germanium transistors. Music effect pedals make use of Germanium because of the way that signals are distorted by the device's characterists - pedals such as a Fuzz box - which is by far the largest use of Germanium today. Thus, the few transistors that are used in effect pedals do have some models to be found. 

However, there were many hundreds of different Germanium transistors sold, the vast majority of which have no models online. IBM made use of almost 200 transistor types for SMS and SLT. This is where my problem lies.

GERMANIUM VERSUS SILICON GROSS BEHAVIOR DIFFERENCES

Silicon semiconductors tend to have a turn-on voltage across the base-emitter junction of around 0.6V while Germanium semiconductors turn on at much lower levels. typically 0.1 to 0.3V. The operation of a transistor with a given voltage at the base can be very different between Germanium and Silicon, as a consequence. 

Germanium transistors operated in reverse mode (switching the emitter and collector) work better than Silicon transistors in the same mode. The amplification factor (beta) is less in reverse mode, but at a reasonable level with Germanium. Other characteristics worse for both types in reverse mode, but there are some circuits (especially effects pedals) that chose to use the transistor in reverse mode. 

Germanium devices have higher leakage currents and are less stable under temperature variations than Silicon. They also are more susceptible to failure due to air leaking into the package than Silicon. Silicon forms an insulating oxide when exposed to air, which limits the impact on the device, while Germanium does not. Finally, the way that the component leads enter the typical Germanium package were susceptible to breaking or corrosion forming at the entry point. 

IBM labeled their transistors and diodes with their own designator, even if the part was procured from an industry source who sold the same part with an industry recognized number. Thus even if a model had existed for a particular transistor under its commonly known number, to model an IBM circuit required knowledge of the IBM to industry standard number translation. 

GRADUALLY EXPERIMENTING WITH SPICE MODELS FOR SOME IBM CIRCUITS

I have been hacking at some models that exist for Germanium devices, trying to get the IBM circuit to operate as it should. I have found a table that circulated among IBM repair people (Field Engineers - FEs) during the SMS era that purports to list industry standard transistors that could be substituted for an IBM numbered transistor in a pinch. These may list five or six different transistors, thus making clear that the substitute is NOT an exact match. 

I have located some spec sheets for the industry standard transistors in that substitution table and from that I have worked up a potential set of specifications for the IBM part, such as hFE and Vceo, that would be the basis for a spice model of that IBM part. This is challenging because a spice model does not have entries like hFE, but instead has a myriad of parameters as you can see below:

My challenge is to turn the potential specifications I derived such as hFE into the parameters above. This is a work in progress. It will be quite valuable in the long run to be able to model IBM circuits accurately. 

Replacing parts on 6V regulator SMS card to resolve 1130 power issues - part 2

TESTING TRANSISTORS WITH CURVE TRACER

I unsoldered all the transistors from the board so that I could put them on the curve tracer to verify whether the transistor was working properly. There are two 026, an 086, a 123 and a 108 transistor that I removed. I have ready replacements for some but I don't have a spare 123. 

Originally the failure occurred after the regulator has been operating for a while, was powered down, and then power applied again within a minute or two. That may mean that when the transistor heats up its behavior changes, so I will apply some heat and cold air while testing the transistors. 

I tested the 123 and 086, which seemed to behave properly and were not so sensitive to heat or cold that they misbehaved. I unmounted the 108 transistor from the heat sink and found it to be quite flakey on the curve tracer. 

REPLACING SUSPECT TRANSISTOR

I used a spare 108 that I owned to replace the bad one. In addition to the spare I used, I had bought a large set of 108 transistors from eBay years ago. When I began testing them, I found wildly different amplification ratios (beta) among them, no two the same. I wonder if these were simply printed with 108 and sold as rare transistors, but are actually various PNP parts of a different type. Counterfeit integrated circuits are a widespread problem, but perhaps I blundered into some counterfeit transistors. 

RESULTS OF POWER CYCLING

The machine was much better, so much so that I had begun to believe the problem had been fully resolved. However, I did manage to get it to fail in the same way - oscillations around 3V - it just took more to force the problem. Drat. 

POSSIBLE NEXT STEPS

I can test the two 026 transistors, since I do have spares to use. I did pull the two diodes and test them, which also let me determine that an IBM DY diode is a 3V Zener. 

I could also test the six 108 transistors in the rest of the regulator, which might be the failing component somehow. 

Replacing parts on 6V regulator SMS card to resolve 1130 power issues - part 1

REPLACING ALL RESISTORS

My package from Digikey finally arrived after the fulfillment delays and then the snowstorm related delivery service delays. The next day I went to the workshop to swap in all the replacement resistors. These were the parts that had deviated from their nominal values which might have contributed to the misbehavior of the regulator. 

INTERMITTENT FAILURE CONVERTED TO STEADY FAILURE

With the parts changed, the regulator now enters the same state that it only did on a repower before - where the output is down around 3V with oscillations, ballooning the current into the regulator required to drop 15V to 3V, resulting the the circuit breaker tripping. Previously the machine would power up fine when cold, run for a while, then if it were powered back up after only a few minutes powered down, this state would occur.

I choose to believe this is progress. A steady failure can be investigated and the root cause found. I have been trying to recreate the failure behavior by shorting or opening various components under LTspice but have not yet been successful. I will begin to remove the transistors and put them on the curve tracer so that I can spot any obviously defective such part. 

Deconstructing the +6V regulator SMS card schematic to isolate functions

DIGIKEY IS SLOW TO FILL MY PARTS ORDER DUE TO HEAVY VOLUME

As the parts have not yet been shipped, they will not arrive by midweek as I had expected. I took the time to document the regulator and explain some of its function.

REGULATOR HAS AN SMS CARD TO REGULATE THE VOLTAGE PLUS OTHER PARTS

The regulator has six IBM type 108 germanium power transistors each on a large heat sink, a circuit breaker, a few other parts and then two SMS cards. One card simply detects when the output voltage is above a trigger threshold, so that it can short the output to cause the circuit breaker to trip. The other is the logic that drives the six power transistors so that the current they are passing will produce a 6V voltage drop over the load. 

The schematic for the regulator includes all the above parts. In addition, it is drawn with the IBM conventions where they show electron flow from the top to the bottom, upside down from the usual orientation in drawing circuits that considers current to flow from positive to negative. IBM also draws transistors in a non-standard way. 

DIFFERENTIAL/COMPARATOR PORTION OF THE CIRCUIT

The two transistors above have their emitters connected through an emitter resistor. This biases the voltage needed on the base of the transistor to cause it to conduct - the more current through the pair of transistors, the higher the voltage drop on R5 which means that the base needs to be more negative to enter the conduction region. 

The right transistor feeds a bias current to the power transistor driver, based on the voltage seen across the output terminals of the regulator. It is trimmed by a potentiometer to produce the 6V voltage drop on the load. The left transistor drives the amplifier based on a fixed voltage from a Zener diode.

If the voltage across the output dips below 6V, the right transistor has less current flow or cuts off, lowering the total current through the emitter resistor R5. This causes the left transistor to conduct more heavily. The left transistor current is amplified and drives the power transistors to increase current leading to restoration of the output voltage. 

If the voltage across the load bumps over 6V, the right transistor conducts more heavily, which increases the emitter resistor R5 voltage drop. That lowers the conduction of the left transistor, the amplifier has a lower output and therefore the power transistors lower the current to the load until the voltage drop restores to 6V. 

AMPLIFIER PORTION OF THE CIRCUIT

The differential circuit left transistor output current is fed into the base of transistor T3. As the differential circuit requests more power, transistor T3 conducts more heavily. Its output feeds the base of transistor T4, adding further gain. T4 delivers more current from the - input rail to the base of transistor T6, again being amplified to pass current from the - rail to the bases of the six power transistors. 

POWER PORTION OF THE CIRCUIT

Six IBM type 108 transistors operate in parallel to deliver the current requirements of this regulator. It is capable of delivering 24A across the load. The transistors have emitter resistors that cause these to balance the load across the six. As a transistor delivers more current, the voltage drop on its emitter resistor rises so that the voltage difference at the base lowers to decrease conduction. 

OVERVOLTAGE PROTECTION CARD

A differential pair of transistors T2 and T3 compare the fixed voltage of a Zener diode on the left with a fraction of the actual output voltage delivered to the right transistor through an adjustable potentiometer. When the voltage on the right transistor gets high enough, the right transistor conducts enough to reach the trigger voltage level for the silicon controlled rectifier (SCR) SCR4. Once triggered the SCR stays in conduction until power is removed. As SCR4 conducts, it delivers the trigger voltage to SCR46, which shorts the entire output of the regulator. 

This circuit will force the circuit breaker to trip on the regulator. It fires in a few tens of microseconds, protecting the logic components in the 1130 from damage if the voltage is too high. The potentiometer is set to a protective target, e.g. 6.8V, where the card will cut off the output voltage. 

Further dive into the 6V regulator circuit breaker spurious tripping

SET SCOPE TO TRIGGER IF REGULATOR OUTPUT HITS 6.7 OR HIGHER

I hooked the oscilloscope up to the 6V output of the regulator and set the trigger to a level of 6.7V so that I would see whether a high level is the cause of the spurious tripping of the circuit breaker. The overvoltage protection card will trip in a few tens of microseconds if the voltage is above the 6.8V trigger level I had set. 

The system tripped immediately, so I isolated the logic from the regulator and then watched the voltage on the output without the overvoltage protection card installed. It zoomed up to 15V and stayed there. I pulled the regulator card out and found a solder bridge defect where I had removed and replaced a couple of parts. After removing the solder bridge, the regulator worked properly and generated 6V. I hooked the logic back up.

The observed voltage completely dashes the theory that the breaker is tripping due to an overvoltage condition detected by the overvoltage protection card which clamps the output to zero. What I am seeing instead is that when I power down for a short interval and then power back up, the voltage comes up to about 3V and oscillates around that level, leading to excessive current draw which trips the breaker.

POTENTIAL CAUSES

It is possible that some parts out in the 1130 logic are producing a short circuit under the repower conditions I am seeing, causing the 24A capacity of the regulator to be unable to deliver 6V. For there to be 3V at the regulator output, the resistance of the load must be about the same as the equivalent series resistance of the regulator. 

The regulator has a 0.072 ohm 90W resistor that all power must flow through. If that were the ESR, just to make a simplifying assumption, then the resistance out to the short would have to be roughly the same. to create a voltage divider. That resistance is equivalent to more than 50 feet of 12 gauge solid wire, while the size of the 1130 and its use of stranded wire make this very unlikely to be the cause.

The other area of suspicion is that this is a defect in the regulator. That is either caused by out of spec parts values or a defective semiconductor device. 

I have ordered a complete set of replacement resistors to bring all the values in line with the design. I should be replacing them midweek and testing again. If the problem persists, I have seven semiconductor parts that may be at fault. Intermittent contacts in the germanium transistors or oxidation defects on the transistor could be occurring, although why that will happen only in the repower scenario is a mystery. The same is true for a zener diode and a regular diode that are part of the comparator on the card. 

The failure scenario involves the regulator driving insufficient current to produce 6V across the load. That may be a clue to the part of the regulator circuit that is failing in the repower situation. However, it could be due to a number of different parts malfunctioning or being off value. 

The regulator has six germanium power transistors (IBM 108 transistor type) in parallel to deliver the current needed for a 6V output. The six power transistors have their base junctions driven by another 108 germanium power transistor mounted on the regulator's SMS card. If we call this the drive transistor, then its delivered current is controlled by a cascade of two smaller transistors, a type 086 controlling a type 123 that feeds the base of the driver 108 transistor. 

The regulator heart is a pair of type 026 transistors set up as a differential amplifier with a shared emitter resistor. One transistor is driven by the output voltage, using an adjustable resistor to fine tune the target voltage. The other transistor is set with a Zener diode to a fixed reference voltage. As the actual voltage rises above or falls below the target, current through one of the 026 transistors moves to decrease or increase the current into the 086 transistor. That lowers or raises the current through the 123, the driver 108 and then the six power 108 transistors, restoring the output voltage to the target. 

Ordered new components for 6V regulator SMS card for IBM 1130

REPLACING ALL RESISTORS

I found a few with significant drift but most were off nominal enough to warrant my replacing all of them. I ordered the correct parts from Digikey and should have them early next week to swap onto the board. In the interim, I will put the card together with its existing parts and do some other debugging of the issue where the regulator's circuit breaker trips on power-up if the system had been on for a while and only recently powered down.