Financial Information eXchange
This article includes a list of general references, but it remains largely unverified because it lacks sufficient corresponding inline citations. (March 2014) |
The Financial Information eXchange (FIX) protocol is an electronic communications protocol initiated in 1992 for international real-time exchange of information related to securities transactions and markets. With trillions of dollars traded annually on the NASDAQ alone, financial service entities are employing direct market access (DMA) to increase their speed to financial markets. Managing the delivery of trading applications and keeping latency low increasingly requires an understanding of the FIX protocol.
History[]
The FIX protocol specification was originally authored in 1992 by Robert "Bob" Lamoureux and Chris Morstatt to enable electronic communication of equity trading data between Fidelity Investments and Salomon Brothers. FIX initially addressed information between broker-dealers and their institutional clients. At the time, this information was communicated verbally over the telephone. Fidelity realized that information from their broker-dealers could be routed to the wrong trader, or simply lost when the parties hung up their phones. It wanted such communications to be replaced with machine-readable data which could then be shared among traders, analyzed, acted on and stored. For example, broker-dealers call with an indication of interest (IOI) to buy or sell a block of stock. The FIX initiative created new messages such as the IOI.
According to the FIX Trading Community, FIX has become the de facto messaging standard for pre-trade and trade communication in the global equity markets, and is expanding into the post-trade space to support straight-through processing, as well as continuing to expand into foreign exchange, fixed income and derivatives markets.[1]
FIX Trading Community[]
The FIX Trading Community is a non-profit, industry-driven standards body with a mission to address the business and regulatory issues impacting multi-asset trading across the global financial markets through the increased use of standards, including the FIX Protocol messaging language, delivering operational efficiency, increased transparency, and reduced costs and risk for all market participants.[2]
Users[]
FIX is widely used by both the buy side (institutions) as well as the sell side (brokers/dealers) of the financial markets. Among its users are mutual funds, investment banks, brokers, stock exchanges and ECNs. See FIX Trading Community Organization for an extensive list of major FIX users.
FIX has become the standard electronic protocol for pre-trade communications and trade execution. Although it is mainly used for equity transactions in the front office area, bond, derivatives and FX-transactions are also possible. One could say that whereas SWIFT is the standard for back office messaging, FIX is the standard for front office messaging. However, today, the membership of FIX Protocol Ltd. is extending FIX into block trade allocation and other phases of the trading process, in every market, for virtually every asset class.
Technical specifications[]
Originally, the FIX standard was monolithic, including application layer semantics, message encoding, and session layer in a single technical specification. It remained monolithic through FIX version 4.2.[3] Thereafter, message encodings and session layer specifications began to be split into separate documents, and ultimately, FIX evolved into a family of related technical standards.[4]
Message encodings[]
Message encoding, called Presentation Layer in the Open Systems Interconnection model (OSI model), is responsible for the wire format of messages.
Tagvalue encoding (classic FIX)[]
The original FIX message encoding is known as tagvalue encoding. Each field consists of a unique numeric tag and a value. The tag identifies the field semantically. Therefore, messages are self-describing. Tagvalue encoding is character-based, using ASCII codes.
FIX tagvalue message format[]
The message fields are delimited using the ASCII 01 <start of header> character. They are composed of a header, a body, and a trailer.
Up to FIX.4.4, the header contained three fields: 8 (BeginString
), 9 (BodyLength
), and 35 (MsgType
) tags.
From FIXT.1.1 / FIX.5.0, the header contains five mandatory fields and one optional field: 8 (BeginString
), 9 (BodyLength
), 35 (MsgType
), 49 (SenderCompID
), 56 (TargetCompID
) and 1128 (ApplVerID
- if present must be in 6th position).
The content in the body of the message is specified by (tag 35, MsgType
) message type defined in the header .
The last field of the message is tag 10, FIX Message Checksum. It is always expressed as a three-digit number (e.g. 10=002
).
Header+Body+Trailer : FIX Content
Example of a FIX message : Execution Report (Pipe character is used to represent SOH character)
8=FIX.4.2 | 9=178 | 35=8 | 49=PHLX | 56=PERS | 52=20071123-05:30:00.000 | 11=ATOMNOCCC9990900 | 20=3 | 150=E | 39=E | 55=MSFT | 167=CS | 54=1 | 38=15 | 40=2 | 44=15 | 58=PHLX EQUITY TESTING | 59=0 | 47=C | 32=0 | 31=0 | 151=15 | 14=0 | 6=0 | 10=128 |
In the above FIXMessage Body length 9 is correct and checksum 10 was checked out by using the source available from QuickFIX, an open-source FIX implementation.
Body[]
FIX messages are formed from a number of fields; each field is a tag value pairing that is separated from the next field by a delimiter SOH (0x01). The tag is an integer that indicates the meaning of the field. The value is an array of bytes that hold a specific meaning for the particular tag (e.g. tag 48 is SecurityID, a string that identifies the security; tag 22 is IDSource, an integer that indicates the identifier class being used). The values may be in plain text or encoded as pure binary (in which case the value is preceded by a length field). The FIX protocol defines meanings for most tags, but leaves a range of tags reserved for private use between consenting parties.
The FIX protocol also defines sets of fields that make a particular message; within the set of fields, some will be mandatory and others optional. The ordering of fields within the message is generally unimportant, however repeating groups are preceded by a count and encrypted fields are preceded by their length. The message is broken into three distinct sections: the head, body and tail. Fields must remain within the correct section and within each section the position may be important as fields can act as delimiters that stop one message from running into the next. The final field in any FIX message is tag 10 (checksum).
There are two main groups of messages—admin and application. The admin messages handle the basics of a FIX session. They allow for a session to be started and terminated and for recovery of missed messages. The application messages deal with the sending and receiving of trade-related information such as an order request or information on the current state and subsequent execution of that order.
Header[]
Body length[]
Body length is the character count starting at tag 35 (included) all the way to tag 10 (excluded). SOH delimiters do count in body length.
For Example: (SOH have been replaced by'|')
8=FIX.4.2|9=65|35=A|49=SERVER|56=CLIENT|34=177|52=20090107-18:15:16|98=0|108=30|10=062| 0 + 0 + 5 + 10 + 10 + 7 + 21 + 5 + 7 + 0 = 65
Has a Body length of 65.
The SOH delimiter at the end of a Tag=Value belongs to the Tag.
Trailer: Checksum[]
The checksum of a FIX message is always the last field in the message. It is composed of three characters and has tag 10.[5] It is given by summing the ASCII value of all characters in the message, except for those of the checksum field itself, and performing modulo 256 over the resulting summation.[6] For example, in the message above, the summation of all ASCII values (including the SOH character, which has a value of 1 in the ASCII table) results in 4158. Performing the modulo operation gives the value 62. Since the checksum is composed of three characters, 062 is used.
FIXML[]
FIXML[7] is an XML schema for FIX messages. It is semantically equivalent to tagvalue encoded messages but takes advantage of XML parser technology. FIXML is commonly used for back-office and clearing applications rather than trading.
Simple Binary Encoding (SBE)[]
Simple Binary Encoding[8] defines a wire format using primitive data types that are native to computing systems. Message encoding and decoding is therefore much lower latency than character-based protocols since no translation is needed to put data into a format that computers can use. Aside from latency advantages, performance is more deterministic because SBE messages are constrained by templates and fixed-length data elements are preferred. Another consequence is that fields are generally at a fixed position so that message filters and routers do not need to crack an entire message to access key fields.
SBE was developed by the FIX High Performance Working Group to support high performance trading. Tagvalue encoding was deemed no longer fit-for-purpose since it is character based rather than binary and its variable-length fields and messages result in non-deterministic performance.
Unlike tagvalue and FIXML, an SBE message is not self-describing. Only data is sent on the wire with a minimal header to identify the template that controls a message. Metadata that describes a message layout is exchanged out-of-band between peers.
FIX Trading Community publishes an XML schema for SBE message schemas. A message schema may contain any number of message templates. A template describes the fields that constitute a message. Additionally, a schema provides a listing of simple and composite data types that may be reused by any number of fields.
From a practical perspective, assuming a C/C++ implementation, and adjusting for endianness: most non-composite types in the message directly map to the same type in the language. For example, 32-bit integer maps to uint32_t
, fixed strings maps const char *
, floating point maps to float
and so on. One can generate a C/C++ struct
from the schema definition. Then, given a pointer to a message buffer, accessing non-composite fields of the message amount to type-casting it to a pointer to structure and accessing structure members directly.
/* Generated struct from schema */
struct Message {
...
uint32_t qty;
...
const char *symbol;
...
};
void consume_message(void *incoming_message) {
const struct Message *msg = (const struct Message*) incoming_message;
printf("Traded %u of %s\n", msg->qty, msg->symbol);
...
}
Other FIX encodings[]
FIX Trading Community has also developed standard mappings between FIX and other message protocols, including:
- Google Protocol Buffers
- ASN.1
- JSON
Session protocols[]
Session layer is responsible for message exchange including checkpoint recovery mechanisms.
FIX Transport (FIXT)[]
The original FIX session protocol did not have its own name since it was part of a monolithic specification covering application layer semantics and message encoding as well. However, starting with FIX version 5.0, the session layer was split off as an independent specification with the introduction of FIXT.[9] FIXT was largely the same as the original unnamed session layer in version 4.x, but it offered one significant innovation--it provided a mechanism to mix FIX application layer versions over a common session version. The current FIXT version is 1.1.
Theoretically, FIXT is transport independent. However it is usually employed over Transmission Control Protocol (TCP).
FIXT is a point-to-point protocol. It guarantees message delivery in both directions. Messages sent in each direction carry a message sequence number in the message header. If there is a communication fault, a peer may request retransmission of missed messages. Message delivery is supported even in the event of disconnection and later reestablishment of a session.
To implement session establishment and guaranteed delivery, FIXT and classic FIX 4.x define these session message types:
- Heartbeat
- Test Request
- ResendRequest
- Reject
- SequenceReset
- Logout
- Logon
- XMLnonFIX
FIX Performance Session Layer (FIXP)[]
FIXP[10] was developed by the FIX High Performance Working Group[11] to meet the needs of high performance trading. The primary need is for low latency message encoding and decoding and control over message delivery guarantees.
To provide low latency, binary message encodings are supported both for session layer and application messages. The actual wire format is abstracted in the FIXP specification, so users may select a FIX encoding of their choice, so long as peers agree on a protocol to use. Early development has used Simple Binary Encoding.
FIXP covers both point-to-point and multicast use cases with common primitives.
When a point-to-point session is established, peers negotiate delivery guarantees from among the following choices:
- Recoverable: exactly-once message delivery. If gaps are detected, then missed messages may be recovered by retransmission.
- Idempotent: at-most-once delivery. If gaps are detected, the sender is notified, but recovery is under control of the application, if it is done at all.
- Unsequenced: makes no delivery guarantees. This choice is appropriate if guarantees are unnecessary or if recovery is provided at the application layer or through a different communication channel.
- None: No application messages should be sent in one direction of a session.
Delivery guarantees may be asymmetrical. For example, a trader may enter orders over an idempotent flow while executions are returned over a recoverable flow. In fast moving markets, the delay inherent in retransmission is often undesirable, resulting in missed opportunities or bad trades.
Diagrammatic representation of FIX system[]
Below is a diagram of how FIX messaging looks between Buyside/Customer and Sellside/Supplier.[12]
Latest developments in FIX protocol[]
The latest version of FIX Protocol implements "Transport Independence" by permitting multiple versions of application messages to be carried over a single version of Transport Independent FIX Session (FIXT.1.1 and higher).
Transport Independence also paves the way for transport protocols such as message queues and web services to be used instead of traditional FIX over TCP.
FIX now supports algorithmic trading by use of FIX Algorithmic Trading Definition Language FIXatdl.
FIX Protocol Limited has released FAST protocol which stands for FIX Adapted for Streaming. FAST is a binary protocol and used mostly for sending Multicast market data via UDP connections.
Testing tools[]
This section contains content that is written like an advertisement. (September 2020) |
Many companies offer FIX testing products and services:
- Sensiple PhiFIX[13]
- FixSpec Central[14]
- FixSpec FIX Workspace[15]
- Lefinsys Testamatiq[16]
- B2Bits FACTS[17]
- CameronTec VeriFIX[18]
- Esprow ETP Studio for FIX[19]
- Exactpro Test Tools[20]
- FIX Flyer Ignition [21]
- GDS Fizzer - FIX Fuzzing Framework [22]
- Wipro FIX Examen[23]
See also[]
- FIXatdl
- QuickFIX, an open source FIX implementation
- SWIFT:Message Types
- List of electronic trading protocols
Notes[]
- ^ "What is FIX?". The FIX Protocol Organization. June 8, 2009. Archived from the original on September 9, 2004.
- ^ "Overview • FIX Trading Community". FIX Trading Community. Retrieved 2018-12-06.
- ^ "FIX 4.2 Specification with 20010501 Errata • FIX Trading Community". FIX Trading Community. Retrieved 2018-12-05.
- ^ "FIX Standards • FIX Trading Community". FIX Trading Community. Retrieved 2018-12-05.
- ^ FIX 4.2 : CheckSum <10> field | FIX Dictionary
- ^ Appendix B - CheckSum Calculation | FIX Dictionary
- ^ "FIXML • FIX Trading Community". FIX Trading Community. Retrieved 2018-12-05.
- ^ "Simple Binary Encoding (SBE) • FIX Trading Community". FIX Trading Community. Retrieved 2018-12-05.
- ^ "FIX Transport (FIXT) • FIX Trading Community". FIX Trading Community. Retrieved 2018-12-05.
- ^ "FIX Performance Session Layer (FIXP) • FIX Trading Community". FIX Trading Community. Retrieved 2018-12-05.
- ^ "Home – High Performance Working Group". FIX Trading Community. Retrieved 2018-12-05.
- ^ DeMarco, Darren. "Exploiting Financial Information Exchange (FIX) Protocol?".
- ^ "Sensiple | PhiFIX is a suite of Multi-protocol (FIX, EMAPI, FAST, ITCH & OUCH) based messaging infrastructure for low latency communication in trading". www.phifix.com. Retrieved 2019-02-25.
- ^ "Central by FixSpec". fixspec.com. Retrieved 2019-03-26.
- ^ "FIX Workspace by FixSpec". fixspec.com. Retrieved 2021-07-01.
- ^ "Lefinsys | Testamatiq Fix sender and certification tool". www.lefinsys.com. Retrieved 2016-05-08.
- ^ "B2BITS FIX | FIX Automated Certification and Testing Service". www.b2bits.com. Retrieved 2016-05-08.
- ^ "VeriFIX | Products | CameronTec Group". www.camerontecgroup.com. Retrieved 2016-05-08.
- ^ "Esprow ETP Studio for FIX". www.esprow.com. Retrieved 2016-05-08.
- ^ "Test Tools". www.exactprosystems.com. Retrieved 2016-05-08.
- ^ "FIX Flyer Ignition". www.fixflyer.com. Retrieved 17 March 2017.
- ^ "GDS Fizzer". www.gdssecurity.com.com. Retrieved 25 April 2018.
- ^ "Fix Protocol Testing, Fix Testing Tools | Wipro". www.wipro.com. Retrieved 2016-05-08.
External links[]
- FIX Protocol Ltd. - this official FIX Trading Community website contains FIX Standards
- FIXimate FIX Dictionary FIX Legacy Versions FIX Latest
- FIXwiki - a Wiki dedicated to FIX. A specification reference tool like FIXimate but because it is a wiki it also allows user notes and feedback
- Esprow FIX Tools - an online FIX dictionary browser for all FIX versions, including a FIX message parser
- Full FIX Protocol Dictionary on Onixs - quick and easy to use contemporary dictionary of the FIX Protocol (versions 4.0, 4.1, 4.2, 4.3, 4.4, 5.0, 5.0.SP1, 5.0.SP2, FIXT1.1).
- FixSpec FIX 4.0 FIX 4.1 FIX 4.2 FIX 4.3 FIX 4.4 FIX 5.0 FIX 5.0 SP1 FIX 5.0 SP2 FIXT
- Online Resource including usage notes on Rapid Addition - Online FIX Resource including detailed notes on usage (versions 4.0, 4.2, 5.0 SP2).
- FIXGlobal - Free global trading journal and official magazine of the FIX Protocol.
- What is FIX Protocol? - Non-technical overview of FIX Protocol.
- A simple FIX Decoder written in shell script with sed that runs fast natively on Unix/Linux, in need of updating to the latest FIX version.
- Financial routing standards
- Market data
- Financial metadata
- Network protocols
- Application layer protocols
- Financial industry XML-based standards
- Financial software
- Electronic trading systems
- Financial markets