{"id":7647,"date":"2015-09-23T05:01:10","date_gmt":"2015-09-23T05:01:10","guid":{"rendered":"https:\/\/unknownerror.org\/index.php\/2015\/09\/23\/isaiah-transit-erlang\/"},"modified":"2015-09-23T05:01:10","modified_gmt":"2015-09-23T05:01:10","slug":"isaiah-transit-erlang","status":"publish","type":"post","link":"https:\/\/unknownerror.org\/index.php\/2015\/09\/23\/isaiah-transit-erlang\/","title":{"rendered":"isaiah\/transit-erlang"},"content":{"rendered":"

<\/p>\n

transit-format implementation in Erlang.<\/p>\n

Test and developed on Erlang\/OTP R17.<\/p>\n

NOTE:<\/em> Things are still experimental and subject to change.<\/p>\n

Usage<\/h2>\n
rebar get-deps compile\nerl -pa ebin deps\/*\/ebin\n<\/code><\/pre>\n
A = transit:write(#{ => , 3 => 4}, #{ format => json }).\n%% => \ntransit:read(A, [{format, json}]).\n%% => #{ => , 3 => 4}\n\n%%% JSON Verbose mode\ntransit:write(#{ => , 3 => 4}, #{ format => json_verbose }).\n%% => \n\n%%% msgpack\ntransit:write(#{ => , 3 => 4}, #{ format => msgpack }).\n%% => \n<\/code><\/pre>\n
Benchmarks<\/h2>\n
These benchmarks are run on a Lenovo Thinkpad W540 with a 16 Gigabyte RAM configuration and the following CPU core:<\/p>\n
Intel(R) Core(TM) i7-4900MQ CPU @ 2.80GHz\n<\/code><\/pre>\n
Timings run 300 rounds of encoding of the file transit-format\/examples\/0.8\/example.json<\/code> and then we divide down to get the encoder time for each round. This then forms the base benchmark.<\/p>\n\n\n\n\n\n\n\n\n\n\n\n
Commit<\/th>\nTest<\/th>\nTiming ms<\/th>\n<\/tr>\n
3d3b04e<\/td>\nJSON<\/td>\n#{iso => 31.987, read => 9.976, write => 20.810}<\/td>\n<\/tr>\n
c976ce6<\/td>\nJSON<\/td>\n#{iso => 29.248, read => 8.883, write => 18.700}<\/td>\n<\/tr>\n
9d678c8<\/td>\nJSON<\/td>\n#{iso => 26.6893,read => 7.454,write => 18.178}<\/td>\n<\/tr>\n
3d3b04e<\/td>\nMsgPack<\/td>\n#{iso => 15.911, read => 4.901, write => 12.072}<\/td>\n<\/tr>\n
c976ce6<\/td>\nMsgPack<\/td>\n#{iso => 11.713, read => 3.258, write => 9.051}<\/td>\n<\/tr>\n
9d678c8<\/td>\nMsgPack<\/td>\n#{iso => 11.2637, read => 2.8620, write => 9.0897}<\/td>\n<\/tr>\n
3d3b04e<\/td>\nJSON_Verbose<\/td>\n#{iso => 34.236, read => 9.724, write => 25.638}<\/td>\n<\/tr>\n
c976ce6<\/td>\nJSON_Verbose<\/td>\n#{iso => 36.613, read => 9.572, write => 27.120}<\/td>\n<\/tr>\n
9d678c8<\/td>\nJSON_Verbose<\/td>\n#{iso => 33.36954, read => 8.59574, write => 29.23906}<\/td>\n<\/tr>\n<\/table>\n
Some important timings are that jsx<\/code> decodes in 5.630 ms and msgpack<\/code> decodes in 0.930 ms. These are therefore the minimum timings and the rest is transit-specific overhead of decoding.<\/p>\n
Current limitations<\/h2>\n
    \n
  • Points-in-time before the date 1\/1 1970 are not encoded and decoded correctly.<\/li>\n<\/ul>\n
    Default type mapping<\/h2>\n
    We currently handle the types in the given table with the given mappings.<\/p>\n
    Rationale for the mapping<\/em>: The problem we face in Erlang w.r.t transit is that we can\u2019t really map external data directly into atom()<\/code> types. The reason is the atom-table is limited and an enemy can easily outrun it. Other language implementations are not with this limit, so they will just use keywords as they go along, ignoring all limitations of them in Erlang. Thus, we opt for a solution where the low-level mapping is to map a lot of things into binary types, but tag them as we do so to discriminate them.<\/p>\n
    We chose to handle a \u201cnaked\u201d binary()<\/code> as an UTF-8 string.<\/p>\n
    Mapping override<\/h3>\n
    In order to handle data in a neat Erlang-esque way, it is possible to supply a translation table in the decoder direction. This table is used to handle scalar types and map them into other data. The intended use is to support binary() \u2192 atom()<\/code> conversion for keywords and symbols. But it also useful for direct decoding of other types.<\/p>\n
    9> transit:write({kw, }).<\/code><\/pre>\n","protected":false},"excerpt":{"rendered":"
    transit-format implementation in Erlang. Test and developed on Erlang\/OTP R17. NOTE: Things are still experimental and subject to change. Usage rebar get-deps compile erl -pa ebin deps\/*\/ebin A = transit:write(#{ => , 3 => 4}, #{ format => json }). %% => transit:read(A, [{format, json}]). %% => #{ => , 3 => 4} %%% JSON […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-7647","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/posts\/7647","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/comments?post=7647"}],"version-history":[{"count":0,"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/posts\/7647\/revisions"}],"wp:attachment":[{"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/media?parent=7647"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/categories?post=7647"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/tags?post=7647"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}