Potential display bug in the way mastercoin-tools handles an edge case

[ghost]

from email thread:

Masterchain displays the total amount of 19 MSC was sold in the overview and no MSC are up for sale at the very moment:
https://masterchain.info/Address.html?addr=1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7&currency=MSC

The numbers for 13fb62038d's sell amount are still incorrect/not correctly reflected, which causes an incorrect accept amount to be shown on 67d6302a45380289de0097afdae8d21a84b0a41221ca14319b3e4cdd8952a53b.

[ghost]

Need to create a TMSC case that mimicks the 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 Double Offers bug to verify display of accepted amount in this case is still broken in m-t.

[dexX7]

Can you please describe what you mean with "double offer bugs"?

It's a bit difficult for me to follow what's a bug, what is correct correct or only a display issue, so I looked at this more closely. At first an overview, potential issues based on what I saw and at the end details.

Note: I did not look at the reason why there were differences at all and probably wrong assumptions by the actors, but only at the data available now. Probably everything started with the impression of an available balance of 19 MSC which was actually 18 MSC in reality. I think this relates to the three (?) transactions which caused some trouble earlier where the "tx correction due to a bug - blacklist" was used for a short time.

Events:

1. 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 has a balance of 18 MSC, puts up a sale of 19 MSC.
2. 13z1JFtDMGTYQvtMq5gs4LmCztK3rmEZga accepts 0.68023020 MSC
3. 1MKiW1nYprHTmT4LQvtYZgYGutufKAC2Uj accepts 17.3197698 MSC
4. 1MKiW1nYprHTmT4LQvtYZgYGutufKAC2Uj pays 2.59623349 BTC (equals 17.31.. MSC) and receives 17.31976978 MSC
5. The first accept as well as the leftover accept expire and the remaining 0.68023022 MSC are again available on the DEx
6. 13z1JFtDMGTYQvtMq5gs4LmCztK3rmEZga tries again, but sends an accept for 1.68023022 MSC
7. 13z1JFtDMGTYQvtMq5gs4LmCztK3rmEZga pays 0.25186651 BTC (equals 1.68.. MSC) and receives 0.68023022 MSC

Issue 1: the overview of an address is confusing, because it shows the amounts of the raw transactions, but not the amounts that were traded or available for sale in the first place.

To compare:

• Sold MSC coins:
  1.68023022 MSC, but only 0.68023022 MSC were available for sale and sold
• Sell MSC offers shows:
  19.0 MSC, but only 18 MSC were available for sale

https://masterchain.info/Address.html?addr=1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7&currency=MSC

Issue 2: the raw information about the first expired sale does not match with the raw data I looked at.

See part three later for the full details and differences.

Issue 3: if my understanding of the UI is correct, then there may be an issue with last sale and the "accepted" amount:

It shows:

Amount requested    1.68023022
Amount accepted 1.68023022
Amount bought   0.68023022

I would assume that the "requested" amount is what the buyer tries to lock via an accept transaction, so this number matches. The actually "accepted" amount was 0.68023022, but is shown as 1.68023022. The "bought" amount is the amount that was sold in the end.

The data is from the following page:

https://masterchain.info/sellaccept.html?tx=67d6302a45380289de0097afdae8d21a84b0a41221ca14319b3e4cdd8952a53b

Now let's go into the details:

Part 1:

[D] check_mastercoin_transaction: block 296805
[D] check_mastercoin_transaction: sell offer from 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581
[I] check_mastercoin_transaction: new sell offer on 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581
[D] debug_address: ######## 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 Mastercoin before sell offer >>>>>>>>
[D] debug_address: balance: 1800000000
[D] debug_address: reserved: 0
[D] debug_address: offer: 0
...
[D] debug_address: ######## 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 Mastercoin after sell offer >>>>>>>>
[D] debug_address: balance: 0
[D] debug_address: reserved: 1800000000
[D] debug_address: offer: 1800000000

According to the validation logs 1C7Am had a balance of 18 MSC before the sell offer, but the raw data of the sell offer itself was for 19 MSC (which is not included in the logs and simply floored to the available balance).

Raw:

Txid: 13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581
Transaction Version: 1
Transaction Type: (20) Sell Mastercoins for Bitcoins
Currency Identifier: Mastercoin
Amount For Sale: 1900000000
Bitcoin Desired: 284810000
Block Time Limit: 14

Masterchain.info shows this offer is for 19 MSC, which is correct in terms of the raw transaction, but doesn't reflect the reality, because only 18 MSC are available to be sold:

https://masterchain.info/selloffer.html?tx=13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581&currency=MSC

Masterchest shows a sale of 18 MSC:

https://masterchest.info/lookuptx.aspx?txid=13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581

Part 2:

Then the following happened:

13z1JFtDMGTYQvtMq5gs4LmCztK3rmEZga accepted the offer and wants to buy 0.68023020 MSC.

[D] check_mastercoin_transaction: sell accept from 13z1JFtDMGTYQvtMq5gs4LmCztK3rmEZga to 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 f726c8995a7da5e009801958027e3bf7a1123e66134fc713e3b8a8f99e81de85
[D] check_mastercoin_transaction: match sell accept f726c8995a7da5e009801958027e3bf7a1123e66134fc713e3b8a8f99e81de85 with sell offer 13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581
[D] check_mastercoin_transaction: with sell offer amount available of 18.0
[D] check_mastercoin_transaction: no accept offers on sell offer yet
[D] check_mastercoin_transaction: amount accepted for f726c8995a7da5e009801958027e3bf7a1123e66134fc713e3b8a8f99e81de85 is 0.6802302
...
[D] debug_address: ######## 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 Mastercoin after sell accept >>>>>>>>
[D] debug_address: balance: 0
[D] debug_address: reserved: 1800000000
[D] debug_address: offer: 1731976980

Raw data of this sell accept:

Txid: f726c8995a7da5e009801958027e3bf7a1123e66134fc713e3b8a8f99e81de85
Transaction Version: 0
Transaction Type: (22) Purchase Mastercoins with Bitcoins
Currency Identifier: Mastercoin
Amount: 68023020

But Masterchain.info shows this accept offer as invalid with the message: "accept offer with missing amount available on sell offer":

https://masterchain.info/sellaccept.html?tx=f726c8995a7da5e009801958027e3bf7a1123e66134fc713e3b8a8f99e81de85&currency=MSC

According to the local logs this seems to be wrong at this point. Let's keep in mind: there is a pending accept of 0.6802302 MSC from 13z1JFtDMGTYQvtMq5gs4LmCztK3rmEZga.

A closer look for the raw data used by masterchain.info:

https://masterchain.info/tx/f726c8995a7da5e009801958027e3bf7a1123e66134fc713e3b8a8f99e81de85.json

[{
  "amount": "00000000040df2ec",
  "baseCoin": "00",
  "bitcoin_required": "Not available",
  "block": "296833",
  "color": "bgc-invalid",
  "currencyId": "00000001",
  "currency_str": "Mastercoin",
  "dataSequenceNum": "01",
  "details": "unknown_price",
  "exodus_scan": "1EXoDusjGwvnjZUyKkxZ4UHEf77z6A5S4P",
  "formatted_amount": "0.6802302",
  "formatted_amount_requested": "0.6802302",
  "formatted_fee": "0.00011",
  "from_address": "13z1JFtDMGTYQvtMq5gs4LmCztK3rmEZga",
  "icon": "sellaccept",
  "icon_text": "Sell Accept (active)",
  "index": "622",
  "invalid": [true,
    "accept offer with missing amount available on sell offer"
  ],
  "method": "multisig",
  "payment_txid": "Not available",
  "sell_offer_txid": "Not available",
  "status": "Awaiting payment",
  "to_address": "1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7",
  "transactionType": "0016",
  "transactionVersion": "0000",
  "tx_hash": "f726c8995a7da5e009801958027e3bf7a1123e66134fc713e3b8a8f99e81de85",
  "tx_method_str": "multisig",
  "tx_time": "1398011216000",
  "tx_type_str": "Sell accept"
}]

Local log:

[{
  "amount": "00000000040df2ec",
  "baseCoin": "00",
  "bitcoin_required": "0.10196651",
  "block": "296833",
  "btc_offer_txid": "unknown",
  "color": "bgc-expired",
  "currencyId": "00000001",
  "currency_str": "Mastercoin",
  "dataSequenceNum": "01",
  "details": "unknown_price",
  "formatted_amount": "0.6802302",
  "formatted_amount_accepted": 0.6802302,
  "formatted_amount_bought": "0.0",
  "formatted_amount_requested": "0.6802302",
  "formatted_fee": "0.00011",
  "formatted_price_per_coin": "0.1499",
  "from_address": "13z1JFtDMGTYQvtMq5gs4LmCztK3rmEZga",
  "icon": "sellaccept",
  "icon_text": "Payment expired",
  "index": "622",
  "invalid": false,
  "method": "multisig",
  "payment_done": false,
  "payment_expired": true,
  "payment_txid": "Not available",
  "sell_offer_txid": "13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581",
  "status": "Expired",
  "to_address": "1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7",
  "transactionType": "0016",
  "transactionVersion": "0000",
  "tx_hash": "f726c8995a7da5e009801958027e3bf7a1123e66134fc713e3b8a8f99e81de85",
  "tx_method_str": "multisig",
  "tx_time": "1398011216000",
  "tx_type_str": "Sell accept"
}]

Despite the fact that the accept expired nevertheless, let's keep in mind that 0.6802302 are reserved.

Masterchest seems to get it right:

https://masterchest.info/lookuptx.aspx?txid=f726c8995a7da5e009801958027e3bf7a1123e66134fc713e3b8a8f99e81de85

Part 3:

Then there is an accept for 17.3197698 MSC:

Raw:

Txid: 8593540888247a9772fbe0fbcdd765df179779ae0c728e1fe83051f1bf0efe2f
Transaction Version: 0
Transaction Type: (22) Purchase Mastercoins with Bitcoins
Currency Identifier: Mastercoin
Amount: 1731976980

[D] check_mastercoin_transaction: block 296841
[D] check_mastercoin_transaction: sell accept from 1MKiW1nYprHTmT4LQvtYZgYGutufKAC2Uj to 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 8593540888247a9772fbe0fbcdd765df179779ae0c728e1fe83051f1bf0efe2f
[D] check_mastercoin_transaction: match sell accept 8593540888247a9772fbe0fbcdd765df179779ae0c728e1fe83051f1bf0efe2f with sell offer 13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581
...
[D] debug_address: ######## 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 Mastercoin before sell accept >>>>>>>>
[D] debug_address: balance: 0
[D] debug_address: reserved: 1800000000
[D] debug_address: offer: 1731976980
...
[D] check_mastercoin_transaction: update sell offer 13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581 with amount available 0.0
[D] check_mastercoin_transaction: update sell address 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 with reduced offer of 17.3197698
[D] check_mastercoin_transaction: offer of 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 is 0
...
[D] debug_address: ######## 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 Mastercoin after sell accept >>>>>>>>
[D] debug_address: balance: 0
[D] debug_address: reserved: 1800000000
[D] debug_address: offer: 0
[D] debug_address: accept: 0

So: two pending sales for 18 MSC in total at the moment.

Part 4:

There is the payment of 2.59623349 BTC. The price for the MSC was 0.1499 BTC/MSC, thus this should be enough to pay for 17.31976977'9853235490326884589726 MSC (17.31976980 were accepted, so 0.00000002'125... MSC are left unpaid).

(Sidenote: paying one more satoshi would equal a theoretical payment for 17,31976984'656... MSC, or an overpayment of the equivalent of 0.0000004 ... MSC)

https://blockchain.info/tx/01d9e09b4f92620738d76a2a8428b82c182356ea852f94b8e5b51698e06e7e06

According to Masterchain this was a buy of 17.31976978 MSC (same amount on Masterchest):

https://masterchain.info/sellaccept.html?tx=8593540888247a9772fbe0fbcdd765df179779ae0c728e1fe83051f1bf0efe2f&currency=MSC

Note: we should probably be more explicit how floating numbers are treated in general.

Matches with the log:

[D] check_bitcoin_payment: is that a 2.59623349 payment to 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 ?
[D] check_bitcoin_payment: found! checking:
[D] check_bitcoin_payment: bitcoin payment: 01d9e09b4f92620738d76a2a8428b82c182356ea852f94b8e5b51698e06e7e06
[D] check_bitcoin_payment: for sell offer: 13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581
[D] check_bitcoin_payment: run over sell accept list ...
[D] check_bitcoin_payment: ... check accept 8593540888247a9772fbe0fbcdd765df179779ae0c728e1fe83051f1bf0efe2f
[D] check_bitcoin_payment: ... payment timing fits (296841+14 >= 296844)
...
[D] check_bitcoin_payment: ... amount_accepted is 17.3197698
[D] check_bitcoin_payment: ... amount_reserved is 18.0
[D] check_bitcoin_payment: ... amount_available is 0.0
[D] check_bitcoin_payment: ... amount_closed is 17.3197697799
[D] check_bitcoin_payment: ... update sell offer amount available 0.00000002 at 13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581
...
[D] debug_address: ######## 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 Mastercoin after bitcoin payment >>>>>>>>
[D] debug_address: balance: 0
[D] debug_address: reserved: 68023022
[D] debug_address: offer: 2

Results at this point:

0.00000002 MSC reserved for 1MKiW1nYprHTmT4LQvtYZgYGutufKAC2Uj (due to the leftover)
0.68023020 MSC reserved for 13z1JFtDMGTYQvtMq5gs4LmCztK3rmEZga (not yet paid)

Part 5:

Some time later the accept of 0.68 expires:

[D] check_alarm: alarm for block 296847
...
[D] check_alarm: accept offer expired f726c8995a7da5e009801958027e3bf7a1123e66134fc713e3b8a8f99e81de85
[D] check_alarm: update sell transaction 13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581 and address 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 with amount available 0.68023022 after payment expired
...
[D] debug_address: ######## 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 Mastercoin before alarm expired >>>>>>>>
[D] debug_address: balance: 0
[D] debug_address: reserved: 68023022
[D] debug_address: offer: 2
...
[D] debug_address: ######## 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 Mastercoin after alarm expired >>>>>>>>
[D] debug_address: balance: 0
[D] debug_address: reserved: 68023022
[D] debug_address: offer: 68023022

Logs are consistent and a bit later the leftover of 2 willetts (!? xD) expires, too:

[D] check_alarm: alarm for block 296855
...
[D] check_alarm: accept offer 8593540888247a9772fbe0fbcdd765df179779ae0c728e1fe83051f1bf0efe2f was already paid with 01d9e09b4f92620738d76a2a8428b82c182356ea852f94b8e5b51698e06e7e06
[D] check_alarm: reduce left over accept from buyer accept value due to accept expire of 8593540888247a9772fbe0fbcdd765df179779ae0c728e1fe83051f1bf0efe2f

Sounds a bit cryptic (at least for me), but it appears those 2 bits are added to the amount up for sale.

Part 6:

Another accept is incoming from the buyer who let the first 0.68.. expire:

[D] check_mastercoin_transaction: block 296956
[D] check_mastercoin_transaction: sell accept from 12vge5Zok5qVYHxGU69vuD3UvoCJMjPnA6 to 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 67d6302a45380289de0097afdae8d21a84b0a41221ca14319b3e4cdd8952a53b
[D] check_mastercoin_transaction: match sell accept 67d6302a45380289de0097afdae8d21a84b0a41221ca14319b3e4cdd8952a53b with sell offer 13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581
[D] check_mastercoin_transaction: with sell offer amount available of 0.68023022
[D] check_mastercoin_transaction: no accept offers from 12vge5Zok5qVYHxGU69vuD3UvoCJMjPnA6 on sell offer yet
[D] check_mastercoin_transaction: amount accepted for 67d6302a45380289de0097afdae8d21a84b0a41221ca14319b3e4cdd8952a53b is 0.68023022
[D] check_mastercoin_transaction: required_fee is 0.0001
[D] check_mastercoin_transaction: accept_fee is 0.0001
[D] check_mastercoin_transaction: minimal fee is met
[D] check_mastercoin_transaction: update sell accept 67d6302a45380289de0097afdae8d21a84b0a41221ca14319b3e4cdd8952a53b for address 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 with amount accepted 0.68023022
...
[D] debug_address: ######## 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 Mastercoin before sell accept >>>>>>>>
[D] debug_address: balance: 0
[D] debug_address: reserved: 68023022
[D] debug_address: offer: 68023022
[D] debug_address: accept: 0
[D] debug_address: bought: 2600000000
[D] debug_address: sold: 2531976978
...
[D] add_alarm: added first alarm in block 296970 for 67d6302a45380289de0097afdae8d21a84b0a41221ca14319b3e4cdd8952a53b
[D] check_mastercoin_transaction: update sell offer 13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581 with amount available 0.0
[D] check_mastercoin_transaction: update sell address 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 with reduced offer of 0.68023022
[D] check_mastercoin_transaction: offer of 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 is 0
...
[D] debug_address: ######## 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 Mastercoin after sell accept >>>>>>>>
[D] debug_address: balance: 0
[D] debug_address: reserved: 68023022
[D] debug_address: offer: 0
[D] debug_address: accept: 0
[D] debug_address: bought: 2600000000
[D] debug_address: sold: 2531976978

As mentioned above, the log shows only the amounts based on available balances etc., and this accept was actually for 1.68023022 MSC: (raw transaction)

Txid: 67d6302a45380289de0097afdae8d21a84b0a41221ca14319b3e4cdd8952a53b
Transaction Version: 0
Transaction Type: (22) Purchase Mastercoins with Bitcoins
Currency Identifier: Mastercoin
Amount: 168023022

This is reflected by the explorers:

https://masterchain.info/sellaccept.html?tx=67d6302a45380289de0097afdae8d21a84b0a41221ca14319b3e4cdd8952a53b&currency=MSC
https://masterchest.info/lookuptx.aspx?txid=67d6302a45380289de0097afdae8d21a84b0a41221ca14319b3e4cdd8952a53b

Part 7:

In the end this accept was paid, but the buyer assumed it's for 1.68.. MSC and sent 0.25186651 BTC:

https://blockchain.info/tx/46886cdcff50dab670d84788d0fe7fccea21f0a90ab91a5bd910b27c001b5272

[D] check_bitcoin_payment: is that a 0.25186651 payment to 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 ?
[D] check_bitcoin_payment: found! checking:
[D] check_bitcoin_payment: bitcoin payment: 46886cdcff50dab670d84788d0fe7fccea21f0a90ab91a5bd910b27c001b5272
[D] check_bitcoin_payment: for sell offer: 13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581
[D] check_bitcoin_payment: run over sell accept list ...
[D] check_bitcoin_payment: ... check accept 8457bdd39838054e6814ba0732a894936deb5fadc08110eebf0269f58057b32e
[D] check_bitcoin_payment: ... sell accept is for a different sell offer (24abe893645bbf7c16f56e43c6921856e665b18c60a12ddefe9e450a103ea033)
[D] check_bitcoin_payment: ... check accept 1d77cc84bc0cdfc874fb879d0117517e089db201c8d63f25ebf68e9d95d47b75
[D] check_bitcoin_payment: ... sell accept is for a different sell offer (b5cd52d4b815e11c8df7224c4052c9021f6230c9e4b6fc723351ac5687e3f686)
[D] check_bitcoin_payment: ... check accept 5de67e616f9bf133a981f15f9c6e885de282fd26887d1f046f985a081a827cb1
[D] check_bitcoin_payment: ... sell accept is for a different sell offer (a8404f1530fbf0cad47a5b788e22c7fddff94c953d2b9e85e85477cbc6b69965)
[D] check_bitcoin_payment: ... check accept 67d6302a45380289de0097afdae8d21a84b0a41221ca14319b3e4cdd8952a53b
[D] check_bitcoin_payment: ... payment timing fits (296956+14 >= 296963)
[D] debug_address: ######## 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 Mastercoin before bitcoin payment >>>>>>>>
[D] debug_address: balance: 0
[D] debug_address: reserved: 68023022
[D] debug_address: offer: 0
[D] debug_address: accept: 0
[D] debug_address: bought: 2600000000
[D] debug_address: sold: 2531976978
...
[D] check_bitcoin_payment: first bitcoin payment 46886cdcff50dab670d84788d0fe7fccea21f0a90ab91a5bd910b27c001b5272 for accept 67d6302a45380289de0097afdae8d21a84b0a41221ca14319b3e4cdd8952a53b is 0.25186651
[D] check_bitcoin_payment: ... amount_accepted is 0.68023022
[D] check_bitcoin_payment: ... amount_reserved is 0.68023022
[D] check_bitcoin_payment: ... amount_available is 0.0
[D] check_bitcoin_payment: ... amount_closed is 0.68023022
[D] check_bitcoin_payment: ... update sell offer amount available 0.0 at 13fb62038d98ca4680c6295ba10d17b63c050ccde9c4cee7579fd2e148f25581
[D] check_bitcoin_payment: ... sell offer closed for 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7
[D] check_bitcoin_payment: remove alarm for paid 67d6302a45380289de0097afdae8d21a84b0a41221ca14319b3e4cdd8952a53b
[D] remove_alarm: removed alarm at block 296970 for 67d6302a45380289de0097afdae8d21a84b0a41221ca14319b3e4cdd8952a53b
[D] debug_address: ######## 1C7AmZ7sEHNLTWdoU7eUqXDPRuM6kmt5a7 Mastercoin after bitcoin payment >>>>>>>>
[D] debug_address: balance: 0
[D] debug_address: reserved: 0
[D] debug_address: offer: 0
[D] debug_address: accept: 0
[D] debug_address: bought: 2600000000
[D] debug_address: sold: 2600000000

Also shown correct on the explorers:

https://masterchest.info/lookuptx.aspx?txid=46886cdcff50dab670d84788d0fe7fccea21f0a90ab91a5bd910b27c001b5272

https://masterchain.info/btcpayment.html?tx=46886cdcff50dab670d84788d0fe7fccea21f0a90ab91a5bd910b27c001b5272&currency=MSC

[ghost]

Issue 1 and Issue 3 are display issues, purely; we can't change the Masterchain UI so I think you're stuck up a tree there; I won't advocate changing the underlying data because there isn't a UI besides masterchain that uses it, so semantically it makes no difference.

Issue 2: AFAI can tell, you actually can accept or offer any amount in your offer and the UI will display that (amount_accepted or amount_offered), but the protocol will enforce its own rules on your packet based on its knowledge of state (amount_bought) -- This is not good IMO because it can be used to trick users but it is legal within the spec and will likely cause user error in the future

tldr I am worried about how state is documented for offers and accepts but haven't found a solution

[ghost]

I'm of the opinion if we reproduce this in Test, we should be able to have a good test case for fixing the issue, I am looking into this over the wknd

[ghost]

Michael found this today: https://masterchest.info/lookuptx.aspx?txid=f0eae2719e03907abed76ee8397b99c4073b8994dd3213f9df4e4df325636bab

A user who overpaid for some MSC, because of the same bug, see:

https://masterchain.info/sellaccept.html?tx=f63b77e0e8ee7f0a61941dbb9430f84161c61b24c48ee1252b7102f29f794e1a&currency=MSC

this is a critical issue, moving prority -- dexx we should fix this A S A P

[dexX7]

I have the impression that I'm missing the point. Can you please summarize the problem that you see?

What I totally dislike is the UI, because it's confusing and misleading, but this is not what you are referring to, right? But just another example:

https://masterchain.info/Address.html?addr=1QG3Jw5Mf76sQTcvQoe1cqBbX4g5z6ixXb&currency=TMSC

1QG3 has a balance of 0.01 TMSC, puts up 9000 TMSC for sale, Appearingly and on the first glance 4500 TMSC are already sold and even better: the accept of a buyer of 10000 TMSC is also there:

https://masterchain.info/sellaccept.html?tx=d24707901e546a98f83e40e9f4df42ada0510d7d4171b8fb87616e53c486b960

[ghost]

The problem I see is specific to how the UI chooses to display certain elements;

1. first of all, the dust has an amount of 5555, which is a masterchain transaction
2. the protocol allows you to accept any number you want in a MSC packet, but internally tends your request down to the amount you own
3. the UI on masterchain does nothing to make this fact obvious to the user, who then acts on bad/misleading information

example:

Seller 1Gv1Gd86ERbJG8PnXiRx4PTiVtnJ9UY9HL has 50.33506052 MSC

Seller decides to make a sale offer for the whole amount ( 90e84b2d957fe...)

Numerous buyers buy pieces of his offer, one of whom is requesting an amount more than the offer allows (f63b77e0e8ee7f...).

Specifically, the buyer is requesting 1MSC, but the actual amount remaining is 0.00000004 on the seller's account. The total valid accepts add up to 51.33506052, and the seller balance is 50.33506052.

Why do the valid accepts add up this way?

A very malicious-looking bug in the accept code allows users to see their accept as valid for the full inital amount, and misleads them into spending more BTC than they would have with the less misleading information. To see why this is a a problem, consider a shady salesman.

A shady salesman bids you on a car. You take his bid at face value, considering the offer a bargain. After signing the contract and handing over your money, he points out a clause that states you paid for only the steering wheel of the car, and not the car itself. You can see the problem now, I'm sure.

This is what is happening here, specifically, the user thinks he is getting X MSC for Y BTC, but it really is 1/X.

The user here is paying a hefty premium for just the steering wheel, approximately 0.08/0.00000004=2000000% more.

[dexX7]

Thanks, then we are talking about the same thing. This is an UI issue, not a protocol one. Let's pin it down and then see what needs to be fixed, adjusted and improved.

From the seller's side:

If the amount offered for sale exceeds the sending address's available balance (the amount not reserved, committed or in escrow), this indicates the user is offering to sell all coins that are available at the time this sell offer is published. (spec)

Say 1QGE has a balance of 0.01 TMSC and puts up a sale of 9000 TMSC for 90 BTC.

Low level: only 0.01 TMSC available, so put up 0.01 TMSC for sale for a total price of 9000/90*0,01 = 0,0001 BTC.

But ...

Address Overview:

• Top: Coins sold: 0.0055 -- OK
• Top: Open sell: 0.0045 -- OK
• History: Sold TMSC coins: 4500.0 --- FAIL: this amount is what the buyer requested, not what was really sold
• History: Sell TMSC offers: 9000.0 --- FAIL: this amount is what the buyer requested, not what was really accepted/reserved for the user

Sell offer details:

• Price per coin: 0.01 --- OK
• Amount for sell: 9000.0 --- FAIL: this is what the seller pushed, not the real amount that was ever for available for sell
• Amount available: 0.0045 --- OK
• Bitcoin amount desired: 90.0 -- FAIL: same applies
• Bids on this offer: 4500.0 (expired), 4500.0 (closed), 10000.0 (expired), ... --- FAIL: the amounts were what the users requested, but not what was really accepted, reserved or sold

From the buyer's side:

If you send an offer for more coins than are available by the time your transaction gets added to a block, your amount bought will be automatically adjusted to the amount still available.

16X6 sends an accept order for 4500 TMSC.

Low level: only 0.001 TMSC available for sell, so the maximum of 0.001 TMSC is reserved until payment or accept expires.

Sell accept details:

• Price per coin: 0.01 --- OK
• Bitcoin required: 0.0001 --- OK
• Amount bought: 0.0055 --- OK
• Amount requested: 4500.0 --- NEUTRAL: this is indeed what the user requested
• Amount accepted: 4500.0 --- CRITICAL FAIL: this is the amount requested, not the accepted amount of 0.01

The spec on payments:

If you send less than the correct amount of bitcoins, your purchase will be adjusted downwards once the time limit expires. ... If you send more than the correct amount of bitcoins, your bitcoins will be lost ...

The payment from the example is fine.

---

Masterchest shows what really happens, at least partial:

9000 TMSC sell offer where 0.01 TMSC were available:

• Sell 0.01 TMSC for a total of 0.0001 BTC (0.01 BTC each) --- OK

4500 TMSC accept request

• Accept 4500 Test Mastercoin --- NEUTRAL: should include the actually accepted amount

Payment of 0.0055 TMSC:

• 0.000055 BTC were paid -- OK
• 0.0055 TMSC were bought - OK

So now the real question:

Some of those numbers can be adjuested in a way that the user interface may be easier to understand, but this differs greatly from what's done now. I'd go the route zathras goes and rather display the actual numbers instead of the requested ones. What do you think?

[ghost]

Great work dexx, I think the points that are labelled FAIL are the fixes we need to implement. As far as what we should display, I think keeping the changes minimal will help keep things working smoothly and introduce a minimum of bugs:

KEYFIX: Amount accepted: 4500.0 --- CRITICAL FAIL: this is the amount requested, not the accepted amount of 0.01 This has to be fixed at a minimum for this bug to be considered closed

The other FAILS are related to mainly whether we choose a MasterChest or MasterChain method of displaying data to the user. Personally, I like giving the user all the information as MasterChain has done, but highlighting the most important parts or offering a tooltip to explain what each field means. I understand however some might find this "too much information" and just prefer the necessary info to make a decision.

Technical Addendum:

FYI, there's only two fields that needs to be fixed to clear all the FAILS, including the CRITICAL one, and its the k'amount accepted' in the UI and k'amount' field for Sells.

On k'amount_accepted':
This is where our CRITICAL BUG is, you can see the calculation here: https://github.com/mastercoin-MSC/mastercoin-tools/blob/master/msc_validate.py#L1523.

It looks like the wrong field is used on the UI, grazcoin uses 'formatted_amount' instead of 'formatted_amount_accepted', which holds the correct value: https://github.com/grazcoin/mastercoin-tools/blob/master/www/sellaccept.html#L115-L116.
(See https://test.omniwallet.org/explorer/inspector?view=d1f2c8bc7364e81d2bd0a47a9a73bff0794fd1009056057656147c31b9b356f7 for example values)

Sell Offer changes:

* Copy k'amount' to new field k'amount_sell_requested' 
* Assign k'amount_available' to k'amount'

Reasoning:
We should keep the 'amount for sell requested' data and display it to the user as a separate field. We should update the 'amount' field with the actual 'amount available' for the UI to display. You can see the calculation for 'amount_available' here: https://github.com/mastercoin-MSC/mastercoin-tools/blob/master/msc_validate.py#L1310.

[ghost]

Simplified these two changes:

For sells, just going to rename the text field, that way its more accurate: https://github.com/grazcoin/mastercoin-tools/blob/master/www/selloffer.html#L107-L108

For accepts, like discussed above, we just need to have the correct field.

PR here, let me know what you think, and I'll send it up: https://github.com/faizkhan00/mastercoin-tools/commit/152a79c4a8adf4b835ddb96affbcd60aede879dc

[ghost]

*Sold TMSC coins: 4500.0 --- FAIL: this amount is what the buyer requested, not what was really sold

There's no way for me to fix this that I see without doing a deeper change, since its up to the protocol to determine this value, and I don't want to change the existing data structure to make it in the fix, if possible. Can you see a way?

*Bitcoin amount desired: 90.0 -- FAIL: same applies

Should this be changed to 'amount_available*price_per_coin' instead?

[ghost]

Okay DexX, please check out the last 4 commits on graz_master branch off my fork: https://github.com/faizkhan00/mastercoin-tools/commits/graz_master

they contain fixes for the following:

History: Sold TMSC coins: 4500.0 --- FAIL: this amount is what the buyer requested, not what was really sold
History: Sell TMSC offers: 9000.0 --- FAIL: this amount is what the buyer requested, not what was really accepted/reserved for the user
Amount for sell: 9000.0 --- FAIL: this is what the seller pushed, not the real amount that was ever for available for sell
Bitcoin amount desired: 90.0 -- FAIL: same applies
Amount accepted: 4500.0 --- CRITICAL FAIL: this is the amount requested, not the accepted amount of 0.01

Please let me know if the terminology is incorrect to you, and any other concern you might have, thanks.

[ghost]

Renamed the field for 'bitcoin amount desired' because its too misleading to 'bitcoin amount required'

added 1 extra commit

[dexX7]

One moment.

[dexX7]

I think we almost have it! :) Posted my notes here:

https://github.com/faizkhan00/mastercoin-tools/commit/f6935ae8e661d1766e3cbf7f883f5ec752555399#commitcomment-6293733