Ipfs 0.4.10 is a patch release that contains several exciting new features, bugfixes and general improvements. Including new commands, easier corruption recovery, and a generally cleaner codebase.
The ipfs pin
command has two new subcommands, verify
and update
. ipfs pin verify
is used to scan the repo for pinned object graphs and check their
integrity. Any issues are reported back with helpful error text to make error
recovery simpler. This subcommand was added to help recover from datastore
corruptions, particularly if using the experimental filestore and accidentally
deleting tracked files.
ipfs pin update
was added to make the task of keeping a large, frequently
changing object graph pinned. Previously users had to call ipfs pin rm
on the
old pin, and ipfs pin add
on the new one. The 'new' ipfs pin add
call would
be very expensive as it would need to verify the entirety of the graph again.
The ipfs pin update
command takes shortcuts, portions of the graph that were
covered under the old pin are assumed to be fine, and the command skips
checking them.
Next up, we have finally implemented an ipfs shutdown
command so users can
shut down their ipfs daemons via the API. This is especially useful on
platforms that make it difficult to control processes (Android, for example),
and is also useful when needing to shut down a node remotely and you do not
have access to the machine itself.
ipfs add
has gained a new flag; the --hash
flag allows you to select which
hash function to use and we have given it the ability to select blake2b-256
.
This pushes us one step closer to shifting over to using blake2b as the
default. Blake2b is significantly faster than sha2-256, and also is conjectured
to provide superior security.
We have also finally implemented a very early (and experimental) ipfs p2p
.
This command and its subcommands will allow you to open up arbitrary streams to
other ipfs peers through libp2p. The interfaces are a little bit clunky right
now, but shouldn't get in the way of anyone wanting to try building a fully
peer to peer application on top of ipfs and libp2p. For more info on this
command, to ask questions, or to provide feedback, head over to the feedback
issue for the command.
A few other subcommands and flags were added around the API, as well as many other requested improvements. See below for the full list of changes.
- Features
- Add support for specifying the hash function in
ipfs add
(ipfs/go-ipfs#3919) - Implement
ipfs key {rm, rename}
(ipfs/go-ipfs#3892) - Implement
ipfs shutdown
command (ipfs/go-ipfs#3884) - Implement
ipfs pin update
(ipfs/go-ipfs#3846) - Implement
ipfs pin verify
(ipfs/go-ipfs#3843) - Implemented experimental p2p commands (ipfs/go-ipfs#3943)
- Add support for specifying the hash function in
- Improvements
- Add MaxStorage field to output of "repo stat" (ipfs/go-ipfs#3915)
- Add Suborigin header to gateway responses (ipfs/go-ipfs#3914)
- Add "--file-order" option to "filestore ls" and "verify" (ipfs/go-ipfs#3938)
- Allow selecting ipns keys by Peer ID (ipfs/go-ipfs#3882)
- Don't redirect to trailing slash in gateway for
go get
(ipfs/go-ipfs#3963) - Add 'ipfs dht findprovs --num-providers' to allow choosing number of providers to find (ipfs/go-ipfs#3966)
- Make sure all keystore keys get republished (ipfs/go-ipfs#3951)
- Documentation
- Adding documentation on PubSub encodedings (ipfs/go-ipfs#3909)
- Change 'neccessary' to 'necessary' (ipfs/go-ipfs#3941)
- README.md: add Nix to the linux package managers (ipfs/go-ipfs#3939)
- More verbose errors in filestore (ipfs/go-ipfs#3964)
- Bugfixes
- Fix typo in message when file size check fails (ipfs/go-ipfs#3895)
- Clean up bitswap ledgers when disconnecting (ipfs/go-ipfs#3437)
- Make odds of 'process added after close' panic less likely (ipfs/go-ipfs#3940)
- General Changes and Refactorings
- Remove 'ipfs diag net' from codebase (ipfs/go-ipfs#3916)
- Update to dht code with provide announce option (ipfs/go-ipfs#3928)
- Apply the megacheck code vetting tool (ipfs/go-ipfs#3949)
- Expose port 8081 in docker container for /ws listener (ipfs/go-ipfs#3954)
Ipfs 0.4.9 is a maintenance release that contains several useful bugfixes and
improvements. Notably, ipfs add
has gained the ability to select which CID
version will be output. The common ipfs hash that looks like this:
QmRjNgF2mRLDT8AzCPsQbw1EYF2hDTFgfUmJokJPhCApYP
is a multihash. Multihashes
allow us to specify the hashing algorithm that was used to verify the data, but
it doesn't give us any indication of what format that data might be. To address
that issue, we are adding another couple of bytes to the prefix that will allow us
to indicate the format of the data referenced by the hash. This new format is
called a Content ID, or CID for short. The previous bare multihashes will still
be fully supported throughout the entire application as CID version 0. The new
format with the type information will be CID version 1. To give an example,
the content referenced by the hash above is "Hello Ipfs!". That same content,
in the same format (dag-protobuf) using CIDv1 is
zb2rhkgXZVkT2xvDiuUsJENPSbWJy7fdYnsboLBzzEjjZMRoG
.
CIDv1 hashes are supported in ipfs versions back to 0.4.5. Nodes running 0.4.4 and older will not be able to load content via CIDv1 and we recommend that they update to a newer version.
There are many other use cases for CIDs. Plugins can be written to allow ipfs to natively address content from any other merkletree based system, such as git, bitcoin, zcash and ethereum -- a few systems we've already started work on.
Aside from the CID flag, there were many other changes as noted below:
- Features
- Add support for using CidV1 in 'ipfs add' (ipfs/go-ipfs#3743)
- Improvements
- Use CID as an ETag strong validator (ipfs/go-ipfs#3869)
- Update go-multihash with keccak and bitcoin hashes (ipfs/go-ipfs#3833)
- Update go-is-domain to contain new gTLD (ipfs/go-ipfs#3873)
- Periodically flush cached directories during ipfs add (ipfs/go-ipfs#3888)
- improved gateway directory listing for sharded nodes (ipfs/go-ipfs#3897)
- Documentation
- Change issue template to use Severity instead of Priority (ipfs/go-ipfs#3834)
- Fix link to commit hook script in contribute.md (ipfs/go-ipfs#3863)
- Fix install_unsupported for openbsd, add docs (ipfs/go-ipfs#3880)
- Bugfixes
- Fix wanlist typo in prometheus metric name (ipfs/go-ipfs#3841)
- Fix
make install
not using ldflags for git hash (ipfs/go-ipfs#3838) - Fix
make install
not installing dependencies (ipfs/go-ipfs#3848) - Fix erroneous Cache-Control: immutable on dir listings (ipfs/go-ipfs#3870)
- Fix bitswap accounting of 'BytesSent' in ledger (ipfs/go-ipfs#3876)
- Fix gateway handling of sharded directories (ipfs/go-ipfs#3889)
- Fix sharding memory growth, and fix resolver for unixfs paths (ipfs/go-ipfs#3890)
- General Changes and Refactorings
- Use ctx var consistently in daemon.go (ipfs/go-ipfs#3864)
- Handle 404 correctly in dist_get tool (ipfs/go-ipfs#3879)
- Testing
- Fix go fuse tests (ipfs/go-ipfs#3840)
Ipfs 0.4.8 brings with it several improvements, bugfixes, documentation improvements, and the long awaited directory sharding code.
Currently, when too many items are added into a unixfs directory, the object gets too large and you may experience issues. To pervent this problem, and generally make working really large directories more efficient, we have implemented a HAMT structure for unixfs. To enable this feature, run:
ipfs config --json Experimental.ShardingEnabled true
And restart your daemon if it was running.
Note: With this setting enabled, the hashes of any newly added directories will be different than they previously were, as the new code will use the sharded HAMT structure for all directories. Also, nodes running ipfs 0.4.7 and earlier will not be able to access directories created with this option.
That said, please do give it a try, let us know how it goes, and then take a look at all the other cool things added in 0.4.8 below.
- Features
- Implement unixfs directory sharding (ipfs/go-ipfs#3042)
- Add DisableNatPortMap option (ipfs/go-ipfs#3798)
- Basic Filestore utilty commands (ipfs/go-ipfs#3653)
- Improvements
- More Robust GC (ipfs/go-ipfs#3712)
- Automatically fix permissions for docker volumes (ipfs/go-ipfs#3744)
- Core API refinements and efficiency improvements (ipfs/go-ipfs#3493)
- Improve IsPinned() lookups for indirect pins (ipfs/go-ipfs#3809)
- Documentation
- Improve 'name' and 'key' helptexts (ipfs/go-ipfs#3806)
- Update link to paper in dev.md (ipfs/go-ipfs#3812)
- Add test to enforce helptext on commands (ipfs/go-ipfs#2648)
- Bugfixes
- Remove bloom filter check on Put call in blockstore (ipfs/go-ipfs#3782)
- Re-add the GOPATH checking functionality (ipfs/go-ipfs#3787)
- Use fsrepo.IsInitialized to test for initialization (ipfs/go-ipfs#3805)
- Return 404 Not Found for failed path resolutions (ipfs/go-ipfs#3777)
- Fix 'dist_get' failing without failing (ipfs/go-ipfs#3818)
- Update iptb with fix for t0130 hanging issue (ipfs/go-ipfs#3823)
- fix hidden file detection on windows (ipfs/go-ipfs#3829)
- General Changes and Refactorings
- Fix multiple govet warnings (ipfs/go-ipfs#3824)
- Make Golint happy in the blocks submodule (ipfs/go-ipfs#3827)
- Testing
- Enable codeclimate for automated linting and vetting (ipfs/go-ipfs#3821)
- Fix EOF test failure with Multipart.Read (ipfs/go-ipfs#3804)
Ipfs 0.4.7 contains several exciting new features! First off, The long awaited filestore feature has been merged, allowing users the option to not have ipfs store chunked copies of added files in the blockstore, pushing to burden of ensuring those files are not changed to the user. The filestore feature is currently still experimental, and must be enabled in your config with:
ipfs config --json Experimental.FilestoreEnabled true
before it can be used. Please see this issue for more details.
Next up, We have merged initial support for ipfs 'Private Networks'. This feature allows users to run ipfs in a mode that will only connect to other peers in the private network. This feature, like the filestore is being released experimentally, but if you're interested please try it out. Instructions for setting it up can be found here.
This release also enables support for the 'mplex' stream muxer by default. This
stream multiplexing protocol was available previously via the
--enable-mplex-experiment
daemon flag, but has now graduated to being 'less
experimental' and no longer requires the flag to use it.
Aside from those, we have a good number of bugfixes, perf improvements and new tests. Heres a list of highlights:
- Features
- Implement basic filestore 'no-copy' functionality (ipfs/go-ipfs#3629)
- Add support for private ipfs networks (ipfs/go-ipfs#3697)
- Enable 'mplex' stream muxer by default (ipfs/go-ipfs#3725)
- Add
--quieter
option toipfs add
(ipfs/go-ipfs#3770) - Report progress during
pin add
via--progress
(ipfs/go-ipfs#3671)
- Improvements
- Allow
ipfs get
to handle content added with raw leaves option (ipfs/go-ipfs#3757) - Fix accuracy of progress bar on
ipfs get
(ipfs/go-ipfs#3758) - Limit number of objects in batches to prevent too many fds issue (ipfs/go-ipfs#3756)
- Add more info to bitswap stat (ipfs/go-ipfs#3635)
- Add multiple performance metrics (ipfs/go-ipfs#3615)
- Make
dist_get
fall back to other downloaders if one fails (ipfs/go-ipfs#3692)
- Allow
- Documentation
- Add Arch Linux install instructions to readme (ipfs/go-ipfs#3742)
- Improve release checklist document (ipfs/go-ipfs#3717)
- Bugfixes
- Fix drive root parsing on windows (ipfs/go-ipfs#3328)
- Fix panic in ipfs get when passing no parameters to API (ipfs/go-ipfs#3768)
- Fix breakage of
ipfs pin add
api output (ipfs/go-ipfs#3760) - Fix issue in DHT queries that was causing poor record replication (ipfs/go-ipfs#3748)
- Fix
ipfs mount
crashing if no name was published before (ipfs/go-ipfs#3728) - Add
self
key to theipfs key list
listing (ipfs/go-ipfs#3734) - Fix panic when shutting down
ipfs daemon
pre gateway setup (ipfs/go-ipfs#3723)
- General Changes and Refactorings
- Refactor
EnumerateChildren
to avoid need for bestEffort parameter (ipfs/go-ipfs#3700) - Update fuse dependency, fixing several issues (ipfs/go-ipfs#3727)
- Add
install_unsupported
makefile target for 'exotic' systems (ipfs/go-ipfs#3719) - Deprecate implicit daemon argument in Dockerfile (ipfs/go-ipfs#3685)
- Refactor
- Testing
- Add test to ensure helptext is under 80 columns wide (ipfs/go-ipfs#3774)
- Add unit tests for auto migration code (ipfs/go-ipfs#3618)
- Fix iptb stop issue in sharness tests (ipfs/go-ipfs#3714)
Ipfs 0.4.6 contains several bugfixes related to migrations and also contains a few other improvements to other parts of the codebase. Notably:
-
The default config will now contain some ipv6 addresses for bootstrap nodes.
-
ipfs pin add
should be faster and consume less memory. -
Pinning thousands of files no longer causes superlinear usage of storage space.
-
Improvements
- Make pinset sharding deterministic (ipfs/go-ipfs#3640)
- Update to go-multihash with blake2 (ipfs/go-ipfs#3649)
- Pass cids instead of nodes around in EnumerateChildrenAsync (ipfs/go-ipfs#3598)
- Add /ip6 bootstrap nodes (ipfs/go-ipfs#3523)
- Add sub-object support to
dag get
command (ipfs/go-ipfs#3687) - Add half-closed streams support to multiplex experiment (ipfs/go-ipfs#3695)
-
Documentation
- Add the snap installation instructions (ipfs/go-ipfs#3663)
- Add closed PRs, Issues throughput (ipfs/go-ipfs#3602)
-
Bugfixes
- Fix auto-migration on docker nodes (ipfs/go-ipfs#3698)
- Update flatfs to v1.1.2, fixing directory fd issue (ipfs/go-ipfs#3711)
-
General Changes and Refactorings
- Remove
FindProviders
from routing mocks (ipfs/go-ipfs#3617) - Use Marshalers instead of PostRun to process
block rm
output (ipfs/go-ipfs#3708)
- Remove
-
Testing
- Makefile rework and sharness test coverage (ipfs/go-ipfs#3504)
- Print out all daemon stderr files when iptb stop fails (ipfs/go-ipfs#3701)
- Add tests for recursively pinning a dag (ipfs/go-ipfs#3691)
- Fix lack of commit hash during build (ipfs/go-ipfs#3705)
- Update to fixed webui. (ipfs/go-ipfs#3669)
- Fix handling of null arrays in cbor ipld objects. (ipfs/go-ipfs#3666)
- Add env var to enable yamux debug logging. (ipfs/go-ipfs#3668)
- Fix libc check during auto-migrations. (ipfs/go-ipfs#3665)
- Fixed json output of ipld objects in
ipfs dag get
(ipfs/go-ipfs#3655)
-
Notable changes
- IPLD and CIDs
- Rework go-ipfs to use Content IDs (ipfs/go-ipfs#3187) (ipfs/go-ipfs#3290)
- Turn merkledag.Node into an interface (ipfs/go-ipfs#3301)
- Implement cbor ipld nodes (ipfs/go-ipfs#3325)
- Allow cid format selection in block put command (ipfs/go-ipfs#3324) (ipfs/go-ipfs#3483)
- Bitswap protocol extension to handle cids (ipfs/go-ipfs#3297)
- Add dag get to read-only api (ipfs/go-ipfs#3499)
- Raw Nodes
- Implement 'Raw Node' node type for addressing raw data (ipfs/go-ipfs#3307)
- Optimize DagService GetLinks for Raw Nodes. (ipfs/go-ipfs#3351)
- Experimental PubSub
- Added a very basic pubsub implementation (ipfs/go-ipfs#3202)
- Core API
- gateway: use core api for serving GET/HEAD/POST (ipfs/go-ipfs#3244)
- IPLD and CIDs
-
Improvements
- Disable auto-gc check in 'ipfs cat' (ipfs/go-ipfs#3100)
- Add
bitswap ledger
command (ipfs/go-ipfs#2852) - Add
ipfs block rm
command. (ipfs/go-ipfs#2962) - Add config option to disable bandwidth metrics (ipfs/go-ipfs#3381)
- Add experimental dht 'client mode' flag (ipfs/go-ipfs#3269)
- Add config option to set reprovider interval (ipfs/go-ipfs#3101)
- Add
ipfs dht provide
command (ipfs/go-ipfs#3106) - Add stream info to
ipfs swarm peers -v
(ipfs/go-ipfs#3352) - Add option to enable go-multiplex experiment (ipfs/go-ipfs#3447)
- Basic Keystore implementation (ipfs/go-ipfs#3472)
- Make
ipfs add --local
not send providers messages (ipfs/go-ipfs#3102) - Fix bug in
ipfs tar add
that buffered input in memory (ipfs/go-ipfs#3334) - Make blockstore retry operations on temporary errors (ipfs/go-ipfs#3091)
- Don't hold the PinLock in adder when not pinning. (ipfs/go-ipfs#3222)
- Validate repo/api file and improve error message (ipfs/go-ipfs#3219)
- no longer hard code gomaxprocs (ipfs/go-ipfs#3357)
- Updated Bash complete script (ipfs/go-ipfs#3377)
- Remove expensive debug statement in blockstore AllKeysChan (ipfs/go-ipfs#3384)
- Remove GC timeout, fix GC tests (ipfs/go-ipfs#3494)
- Fix
ipfs pin add
resource consumption (ipfs/go-ipfs#3495) (ipfs/go-ipfs#3571) - Add IPNS entry to DHT cache after publish (ipfs/go-ipfs#3501)
- Add in
--routing=none
daemon option (ipfs/go-ipfs#3605)
-
Bitswap
- Don't re-provide blocks we've provided very recently (ipfs/go-ipfs#3105)
- Add a deadline to sendmsg calls (ipfs/go-ipfs#3445)
- cleanup bitswap and handle message send failure slightly better (ipfs/go-ipfs#3408)
- Increase wantlist resend delay to one minute (ipfs/go-ipfs#3448)
- Fix issue where wantlist fullness wasn't included in messages (ipfs/go-ipfs#3461)
- Only pass keys down newBlocks chan in bitswap (ipfs/go-ipfs#3271)
-
Bugfixes
- gateway: fix --writable flag (ipfs/go-ipfs#3206)
- Fix relative seek in unixfs not expanding file properly (ipfs/go-ipfs#3095)
- Update multicodec service names for ipfs services (ipfs/go-ipfs#3132)
- dht: add missing protocol ID to newStream call (ipfs/go-ipfs#3203)
- Return immediately on namesys error (ipfs/go-ipfs#3345)
- Improve osxfuse handling (ipfs/go-ipfs#3098) (ipfs/go-ipfs#3413)
- commands: fix opt.Description panic when desc was empty (ipfs/go-ipfs#3521)
- Fixes #3133: Properly handle release candidates in version comparison (ipfs/go-ipfs#3136)
- Don't drop error in readStreamedJson. (ipfs/go-ipfs#3276)
- Error out on invalid
--routing
option (ipfs/go-ipfs#3482) - Respect contexts when returning diagnostics responses (ipfs/go-ipfs#3353)
- Fix json marshalling of pbnode (ipfs/go-ipfs#3507)
-
General changes and refactorings
- Disable Suborigins the spec changed and our impl conflicts (ipfs/go-ipfs#3519)
- Avoid sending provide messages for pinsets (ipfs/go-ipfs#3103)
- Refactor cli handling to expose argument parsing functionality (ipfs/go-ipfs#3308)
- Create a FilestoreNode object to carry PosInfo (ipfs/go-ipfs#3314)
- Print 'n/a' instead of zero latency in
ipfs swarm peers
(ipfs/go-ipfs#3491) - Add DAGService.GetLinks() method to optimize traversals. (ipfs/go-ipfs#3255)
- Make path resolver no longer require whole IpfsNode for construction (ipfs/go-ipfs#3321)
- Distinguish between Offline and Local Modes of daemon operation. (ipfs/go-ipfs#3259)
- Separate out the GC Locking from the Blockstore interface. (ipfs/go-ipfs#3348)
- Avoid unnecessary allocs in datastore key handling (ipfs/go-ipfs#3407)
- Use NextSync method for datastore queries (ipfs/go-ipfs#3386)
- Switch unixfs.Metadata.MimeType to optional (ipfs/go-ipfs#3458)
- Fix path parsing in
ipfs name publish
(ipfs/go-ipfs#3592) - Fix inconsistent
ipfs stats bw
formatting (ipfs/go-ipfs#3554) - Set the libp2p agent version based on version string (ipfs/go-ipfs#3569)
-
Cross Platform Changes
- Fix 'dist_get' script on BSDs. (ipfs/go-ipfs#3264)
- ulimit: Tune resource limits on BSDs (ipfs/go-ipfs#3374)
-
Metrics
- Introduce go-metrics-interface (ipfs/go-ipfs#3189)
- Fix metrics injection (ipfs/go-ipfs#3315)
-
Misc
- Bump Go requirement to 1.7 (ipfs/go-ipfs#3111)
- Merge 0.4.3 release candidate changes back into master (ipfs/go-ipfs#3248)
- Add [email protected] GPG key to assets (ipfs/go-ipfs#2997)
- Improve makefiles (ipfs/go-ipfs#2999) (ipfs/go-ipfs#3265)
- Refactor install.sh script (ipfs/go-ipfs#3194)
- Add test check for go code formatting (ipfs/go-ipfs#3421)
- bin: dist_get script: prevents get_go_vars() returns same values twice (ipfs/go-ipfs#3079)
-
Dependencies
- Update libp2p to have fixed spdystream dep (ipfs/go-ipfs#3210)
- Update libp2p and dht packages (ipfs/go-ipfs#3263)
- Update to libp2p 4.0.1 and propogate other changes (ipfs/go-ipfs#3284)
- Update to libp2p 4.0.4 (ipfs/go-ipfs#3361)
- Update go-libp2p across codebase (ipfs/go-ipfs#3406)
- Update to go-libp2p 4.1.0 (ipfs/go-ipfs#3373)
- Update deps for libp2p 3.4.0 (ipfs/go-ipfs#3110)
- Update go-libp2p-swarm with deadlock fixes (ipfs/go-ipfs#3339)
- Update to new cid and ipld node packages (ipfs/go-ipfs#3326)
- Update to newer ipld node interface with Copy and better Tree (ipfs/go-ipfs#3391)
- Update experimental go-multiplex to 0.2.6 (ipfs/go-ipfs#3475)
- Rework routing interfaces to make separation easier (ipfs/go-ipfs#3107)
- Update to dht code with fixed GetClosestPeers (ipfs/go-ipfs#3346)
- Move go-is-domain to gx (ipfs/go-ipfs#3077)
- Extract thirdparty/loggables and thirdparty/peerset (ipfs/go-ipfs#3204)
- Completely remove go-key dep (ipfs/go-ipfs#3439)
- Remove randbo dep, its no longer needed (ipfs/go-ipfs#3118)
- Update libp2p for identify configuration updates (ipfs/go-ipfs#3539)
- Use newer flatfs sharding scheme (ipfs/go-ipfs#3608)
-
Testing
- fix test_fsh arg quoting in ipfs-test-lib (ipfs/go-ipfs#3085)
- 100% coverage for blocks/blocksutil (ipfs/go-ipfs#3090)
- 100% coverage on blocks/set (ipfs/go-ipfs#3084)
- 81% coverage on blockstore (ipfs/go-ipfs#3074)
- 80% coverage of unixfs/mod (ipfs/go-ipfs#3096)
- 82% coverage on blocks (ipfs/go-ipfs#3086)
- 87% coverage on unixfs (ipfs/go-ipfs#3492)
- Improve coverage on routing/offline (ipfs/go-ipfs#3516)
- Add test for flags package (ipfs/go-ipfs#3449)
- improve test coverage on merkledag package (ipfs/go-ipfs#3113)
- 80% coverage of unixfs/io (ipfs/go-ipfs#3097)
- Accept more than one digit in repo version tests (ipfs/go-ipfs#3130)
- Fix typo in hash in t0050 (ipfs/go-ipfs#3170)
- fix bug in pinsets and add a stress test for the scenario (ipfs/go-ipfs#3273) (ipfs/go-ipfs#3302)
- Report coverage to codecov (ipfs/go-ipfs#3473)
- Add test for 'ipfs config replace' (ipfs/go-ipfs#3073)
- Fix netcat on macOS not closing socket when the stdin sends EOF (ipfs/go-ipfs#3515)
-
Documentation
- Update dns help with a correct domain name (ipfs/go-ipfs#3087)
- Add period to
ipfs pin rm
(ipfs/go-ipfs#3088) - Make all Taglines use imperative mood (ipfs/go-ipfs#3041)
- Document listing commands better (ipfs/go-ipfs#3083)
- Add notes to readme on building for uncommon systems (ipfs/go-ipfs#3051)
- Add branch naming conventions doc (ipfs/go-ipfs#3035)
- Replace keyword with <> (ipfs/go-ipfs#3129)
- Fix Add() docs regarding pinning (ipfs/go-ipfs#3513)
- Add sudo to install commands. (ipfs/go-ipfs#3201)
- Add docs for
"commands".Command.Run
(ipfs/go-ipfs#3382) - Put config keys in proper case (ipfs/go-ipfs#3365)
- Fix link in
ipfs stats bw
help message (ipfs/go-ipfs#3620)
This release contains an important hotfix for a bug we discovered in how pinning works. If you had a large number of pins, new pins would overwrite existing pins. Apart from the hotfix, this release is equal to the previous release 0.4.3.
- Fix bug in pinsets fanout, and add stress test. (@whyrusleeping, ipfs/go-ipfs#3273)
We published a detailed account of the bug and fix in a blog post.
There have been no changes since the last release candidate 0.4.3-rc4. \o/
This release candidate fixes issues in Bitswap and the ipfs add
command, and improves testing.
We plan for this to be the last release candidate before the release of go-ipfs v0.4.3.
With this release candidate, we're also moving go-ipfs to Go 1.7, which we expect will yield improvements in runtime performance, memory usage, build time and size of the release binaries.
- Require Go 1.7. (@whyrusleeping, @Kubuxu, @lgierth, ipfs/go-ipfs#3163)
- For this purpose, switch Docker image from Alpine 3.4 to Alpine Edge.
- Fix cancellation of Bitswap
wantlist
entries. (@whyrusleeping, ipfs/go-ipfs#3182) - Fix clearing of
active
state of Bitswap provider queries. (@whyrusleeping, ipfs/go-ipfs#3169) - Fix a panic in the DHT code. (@Kubuxu, ipfs/go-ipfs#3200)
- Improve handling of
Identity
field inipfs config
command. (@Kubuxu, @whyrusleeping, ipfs/go-ipfs#3141) - Fix explicit adding of symlinked files and directories. (@kevina, ipfs/go-ipfs#3135)
- Fix bash auto-completion of
ipfs daemon --unrestricted-api
option. (@lgierth, ipfs/go-ipfs#3159) - Introduce a new timeout tool for tests to avoid licensing issues. (@Kubuxu, ipfs/go-ipfs#3152)
- Improve output for migrations of fs-repo. (@lgierth, ipfs/go-ipfs#3158)
- Fix info notice of commands taking input from stdin. (@Kubuxu, ipfs/go-ipfs#3134)
- Bring back a few tests for stdin handling of
ipfs cat
andipfs add
. (@Kubuxu, ipfs/go-ipfs#3144) - Improve sharness tests for
ipfs repo verify
command. (@whyrusleeping, ipfs/go-ipfs#3148) - Improve sharness tests for CORS headers on the gateway. (@Kubuxu, ipfs/go-ipfs#3142)
- Improve tests for pinning within
ipfs files
. (@kevina, ipfs/go-ipfs#3151) - Improve tests for the automatic raising of file descriptor limits. (@whyrusleeping, ipfs/go-ipfs#3149)
This release candidate fixes a panic that occurs when input from stdin was expected, but none was given: ipfs/go-ipfs#3050
This release includes bugfixes and fixes for regressions that were introduced between 0.4.2 and 0.4.3-rc1.
- Regressions
- Fix daemon panic when there is no multipart input provided over the HTTP API. (@whyrusleeping, ipfs/go-ipfs#2989)
- Fix
ipfs refs --edges
not printing edges. (@Kubuxu, ipfs/go-ipfs#3007) - Fix progress option for
ipfs add
defaulting to true on the HTTP API. (@whyrusleeping, ipfs/go-ipfs#3025) - Fix erroneous printing of stdin reading message. (@whyrusleeping, ipfs/go-ipfs#3033)
- Fix panic caused by passing
--mount
and--offline
flags toipfs daemon
. (@Kubuxu, ipfs/go-ipfs#3022) - Fix symlink path resolution on windows. (@Kubuxu, ipfs/go-ipfs#3023)
- Add in code to prevent issue 3032 from crashing the daemon. (@whyrusleeping, ipfs/go-ipfs#3037)
This is a maintenance release which comes with a couple of nice enhancements, and improves the performance of Storage, Bitswap, as well as Content and Peer Routing. It also introduces a handful of new commands and options, and fixes a good bunch of bugs.
This is the first Release Candidate. Unless there are vulnerabilities or regressions discovered, the final 0.4.3 release will happen about one week from now.
-
Security Vulnerability
- The
master
branch if go-ipfs suffered from a vulnerability for about 3 weeks. It allowed an attacker to use an iframe to request malicious HTML and JS from the API of a local go-ipfs node. The attacker could then gain unrestricted access to the node's API, and e.g. extract the private key. We fixed this issue by reintroducing restrictions on which particular objects can be loaded through the API (@lgierth, ipfs/go-ipfs#2949), and by completely excluding the private key from the API (@Kubuxu, ipfs/go-ipfs#2957). We will also work on more hardening of the API in the next release. - The previous release 0.4.2 is not vulnerable. That means if you're using official binaries from dist.ipfs.io you're not affected. If you're running go-ipfs built from the
master
branch between June 17th (ipfs/go-ipfs@1afebc21) and July 7th (ipfs/go-ipfs@39bef0d5), please update to v0.4.3-rc1 immediately. - We are grateful to the group of independent researchers who made us aware of this vulnerability. We wanna use this opportunity to reiterate that we're very happy about any additional review of pull requests and releases. You can contact us any time at [email protected] (GPG 4B9665FB 92636D17 7C7A86D3 50AAE8A9 59B13AF3).
- The
-
Notable changes
- Improve Bitswap performance. (@whyrusleeping, ipfs/go-ipfs#2727, ipfs/go-ipfs#2798)
- Improve Content Routing and Peer Routing performance. (@whyrusleeping, ipfs/go-ipfs#2817, ipfs/go-ipfs#2841)
- Improve datastore, blockstore, and dagstore performance. (@kevina, @Kubuxu, @whyrusleeping ipfs/go-datastore#43, ipfs/go-ipfs#2885, ipfs/go-ipfs#2961, ipfs/go-ipfs#2953, ipfs/go-ipfs#2960)
- Content Providers are now stored on disk to gain savings on process memory. (@whyrusleeping, ipfs/go-ipfs#2804, ipfs/go-ipfs#2860)
- Migrations of the fs-repo (usually stored at
~/.ipfs
) now run automatically. If there's a TTY available, you'll get prompted when runningipfs daemon
, and in addition you can use the--migrate=true
or--migrate=false
options to avoid the prompt. (@whyrusleeping, @lgierth, ipfs/go-ipfs#2939) - The internal naming of blocks in the blockstore has changed, which requires a migration of the fs-repo, from version 3 to 4. (@whyrusleeping, ipfs/go-ipfs#2903)
- We now automatically raise the file descriptor limit to 1024 if neccessary. (@whyrusleeping, ipfs/go-ipfs#2884, ipfs/go-ipfs#2891)
- After a long struggle with deadlocks and hanging connections, we've decided to disable the uTP transport by default for now. (@whyrusleeping, ipfs/go-ipfs#2840, ipfs/go-libp2p-transport@88244000)
- There is now documentation for the configuration options in
docs/config.md
. (@whyrusleeping, ipfs/go-ipfs#2974) - All commands now sanely handle the combination of stdin and optional flags in certain edge cases. (@lgierth, ipfs/go-ipfs#2952)
-
New Features
- Add
--offline
option toipfs daemon
command, which disables all swarm networking. (@Kubuxu, ipfs/go-ipfs#2696, ipfs/go-ipfs#2867) - Add
Datastore.HashOnRead
option for verifying block hashes on read access. (@Kubuxu, ipfs/go-ipfs#2904) - Add
Datastore.BloomFilterSize
option for tuning the blockstore's new lookup bloom filter. (@Kubuxu, ipfs/go-ipfs#2973)
- Add
-
Bugfixes
- Fix publishing of local IPNS entries, and more. (@whyrusleeping, ipfs/go-ipfs#2943)
- Fix progress bars in
ipfs add
andipfs get
. (@whyrusleeping, ipfs/go-ipfs#2893, ipfs/go-ipfs#2948) - Make sure files added through
ipfs files
are pinned and don't get GC'd. (@kevina, ipfs/go-ipfs#2872) - Fix copying into directory using
ipfs files cp
. (@whyrusleeping, ipfs/go-ipfs#2977) - Fix
ipfs version --commit
with Docker containers. (@lgierth, ipfs/go-ipfs#2734) - Run
ipfs diag
commands in the daemon instead of the CLI. (@Kubuxu, ipfs/go-ipfs#2761) - Fix protobuf encoding on the API and in commands. (@stebalien, ipfs/go-ipfs#2516)
- Fix goroutine leak in
/ipfs/ping
protocol handler. (@whyrusleeping, ipfs/go-libp2p#58) - Fix
--flags
option onipfs commands
. (@Kubuxu, ipfs/go-ipfs#2773) - Fix the error channels in
namesys
. (@whyrusleeping, ipfs/go-ipfs#2788) - Fix consumptions of observed swarm addresses. (@whyrusleeping, ipfs/go-libp2p#63, ipfs/go-ipfs#2771)
- Fix a rare DHT panic. (@whyrusleeping, ipfs/go-ipfs#2856)
- Fix go-ipfs/js-ipfs interoperability issues in SPDY. (@whyrusleeping, whyrusleeping/go-smux-spdystream@fae17783)
- Fix a logging race condition during shutdown. (@Kubuxu, ipfs/go-log#3)
- Prevent DHT connection hangs. (@whyrusleeping, ipfs/go-ipfs#2826, ipfs/go-ipfs#2863)
- Fix NDJSON output of
ipfs refs local
. (@Kubuxu, ipfs/go-ipfs#2812) - Fix race condition in NAT detection. (@whyrusleeping, ipfs/go-libp2p#69)
- Fix error messages. (@whyrusleeping, @Kubuxu, ipfs/go-ipfs#2905, ipfs/go-ipfs#2928)
-
Enhancements
- Increase maximum object size on
ipfs put
from 1 MiB to 2 MiB. The maximum object size on the wire including all framing is 4 MiB. (@kpcyrd, ipfs/go-ipfs#2980) - Add CORS headers to the Gateway's default config. (@Kubuxu, ipfs/go-ipfs#2778)
- Clear the dial backoff for a peer when using
ipfs swarm connect
. (@whyrusleeping, ipfs/go-ipfs#2941) - Allow passing options to daemon in Docker container. (@lgierth, ipfs/go-ipfs#2955)
- Add
-v/--verbose
toìpfs swarm peers
command. (@csasarak, ipfs/go-ipfs#2713) - Add
--format
,--hash
, and--size
options toipfs files stat
command. (@Kubuxu, ipfs/go-ipfs#2706) - Add
--all
option toipfs version
command. (@Kubuxu, ipfs/go-ipfs#2790) - Add
ipfs repo version
command. (@pfista, ipfs/go-ipfs#2598) - Add
ipfs repo verify
command. (@whyrusleeping, ipfs/go-ipfs#2924, ipfs/go-ipfs#2951) - Add
ipfs stats repo
andipfs stats bitswap
command aliases. (@pfista, ipfs/go-ipfs#2810) - Add success indication to responses of
ipfs ping
command. (@Kubuxu, ipfs/go-ipfs#2813) - Save changes made via
ipfs swarm filter
to the config file. (@yuvallanger, ipfs/go-ipfs#2880) - Expand
ipfs_p2p_peers
metric to include libp2p transport. (@lgierth, ipfs/go-ipfs#2728) - Rework
ipfs files add
internals to avoid caching and prevent memory leaks. (@whyrusleeping, ipfs/go-ipfs#2795) - Support
GOPATH
with multiple path components. (@karalabe, @lgierth, @djdv, ipfs/go-ipfs#2808, ipfs/go-ipfs#2862, ipfs/go-ipfs#2975)
- Increase maximum object size on
-
General Codebase
- Take steps towards the
filestore
datastore. (@kevina, ipfs/go-ipfs#2792, ipfs/go-ipfs#2634) - Update recommended Golang version to 1.6.2 (@Kubuxu, ipfs/go-ipfs#2724)
- Update to Gx 0.8.0 and Gx-Go 1.2.1, which is faster and less noisy. (@whyrusleeping, ipfs/go-ipfs#2979)
- Use
go4.org/lock
instead ofcamlistore/lock
for locking. (@whyrusleeping, ipfs/go-ipfs#2887) - Manage
go.uuid
,hamming
,backoff
,proquint
,pb
,go-context
,cors
,go-datastore
packages with Gx. (@Kubuxu, ipfs/go-ipfs#2733, ipfs/go-ipfs#2736, ipfs/go-ipfs#2757, ipfs/go-ipfs#2825, ipfs/go-ipfs#2838) - Clean up the gateway's surface. (@lgierth, ipfs/go-ipfs#2874)
- Simplify the API gateway's access restrictions. (@lgierth, ipfs/go-ipfs#2949, ipfs/go-ipfs#2956)
- Update docker image to Alpine Linux 3.4 and remove Go version constraint. (@lgierth, ipfs/go-ipfs#2901, ipfs/go-ipfs#2929)
- Clarify
Dockerfile
andDockerfile.fast
. (@lgierth, ipfs/go-ipfs#2796) - Simplify resolution of Git commit refs in Dockerfiles. (@lgierth, ipfs/go-ipfs#2754)
- Consolidate
--verbose
description across commands. (@Kubuxu, ipfs/go-ipfs#2746) - Allow setting position of default values in command option descriptions. (@Kubuxu, ipfs/go-ipfs#2744)
- Set explicit default values for boolean command options. (@RichardLitt, ipfs/go-ipfs#2657)
- Autogenerate command synopsises. (@Kubuxu, ipfs/go-ipfs#2785)
- Fix and improve lots of documentation. (@RichardLitt, ipfs/go-ipfs#2741, ipfs/go-ipfs#2781)
- Improve command descriptions to fit a width of 78 characters. (@RichardLitt, ipfs/go-ipfs#2779, ipfs/go-ipfs#2780, ipfs/go-ipfs#2782)
- Fix filename conflict in the debugging guide. (@Kubuxu, ipfs/go-ipfs#2752)
- Decapitalize log messages, according to Golang style guides. (@RichardLitt, ipfs/go-ipfs#2853)
- Add Github Issues HowTo guide. (@RichardLitt, @chriscool, ipfs/go-ipfs#2889, ipfs/go-ipfs#2895)
- Add Github Issue template. (@chriscool, ipfs/go-ipfs#2786)
- Apply standard-readme to the README file. (@RichardLitt, ipfs/go-ipfs#2883)
- Fix issues pointed out by
govet
. (@Kubuxu, ipfs/go-ipfs#2854) - Clarify
ipfs get
error message. (@whyrusleeping, ipfs/go-ipfs#2886) - Remove dead code. (@whyrusleeping, ipfs/go-ipfs#2819)
- Add changelog for v0.4.3. (@lgierth, ipfs/go-ipfs#2984)
- Take steps towards the
-
Tests & CI
- Fix flaky
ipfs mount
sharness test by using theiptb
tool. (@noffle, ipfs/go-ipfs#2707) - Fix flaky IP port selection in tests. (@Kubuxu, ipfs/go-ipfs#2855)
- Fix CLI tests on OSX by resolving /tmp symlink. (@Kubuxu, ipfs/go-ipfs#2926)
- Fix flaky GC test by running the daemon in offline mode. (@Kubuxu, ipfs/go-ipfs#2908)
- Add tests for
ipfs add
with hidden files. (@Kubuxu, ipfs/go-ipfs#2756) - Add test to make sure the body of HEAD responses is empty. (@Kubuxu, ipfs/go-ipfs#2775)
- Add test to catch misdials. (@Kubuxu, ipfs/go-ipfs#2831)
- Mark flaky tests for
ipfs dht query
as known failure. (@noffle, ipfs/go-ipfs#2720) - Remove failing blockstore-without-context test. (@Kubuxu, ipfs/go-ipfs#2857)
- Fix
--version
tests for versions with a suffix like-dev
or-rc1
. (@lgierth, ipfs/go-ipfs#2937) - Make sharness tests work in cases where go-ipfs is symlinked into GOPATH. (@lgierth, ipfs/go-ipfs#2937)
- Add variable delays to blockstore mocks. (@rikonor, ipfs/go-ipfs#2871)
- Disable Travis CI email notifications. (@Kubuxu, ipfs/go-ipfs#2896)
- Fix flaky
This is a patch release which fixes perfomance and networking bugs in go-libp2p, You should see improvements in CPU and RAM usage, as well as speed of object lookups. There are also a few other nice improvements.
-
Notable Fixes
- Set a deadline for dialing attempts. This prevents a node from accumulating failed connections. (@whyrusleeping)
- Avoid unneccessary string/byte conversions in go-multihash. (@whyrusleeping)
- Fix a deadlock around the yamux stream muxer. (@whyrusleeping)
- Fix a bug that left channels open, causing hangs. (@whyrusleeping)
- Fix a bug around yamux which caused connection hangs. (@whyrusleeping)
- Fix a crash caused by nil multiaddrs. (@whyrusleeping)
-
Enhancements
- Add NetBSD support. (@erde74)
- Set Cache-Control: immutable on /ipfs responses. (@kpcyrd)
- Have
ipfs init
optionally accept a default configuration from stdin. (@sivachandran) - Add
ipfs log ls
command for listing logging subsystems. (@hsanjuan) - Allow bitswap to read multiple messages per stream. (@whyrusleeping)
- Remove
make toolkit_upgrade
step. (@chriscool)
-
Documentation
- Add a debug-guidelines document. (@richardlitt)
- Update the contribute document. (@richardlitt)
- Fix documentation of many
ipfs
commands. (@richardlitt) - Fall back to ShortDesc if LongDesc is missing. (@Kubuxu)
-
Removals
- Remove -f option from
ipfs init
command. (@whyrusleeping)
- Remove -f option from
-
Bugfixes
- Fix
ipfs object patch
argument handling and validation. (@jbenet) - Fix
ipfs config edit
command by running it client-side. (@Kubuxu) - Set default value for
ipfs refs
arguments. (@richardlitt) - Fix parsing of incorrect command and argument permutations. (@thomas-gardner)
- Update Dockerfile to latest go1.5.4-r0. (@chriscool)
- Allow passing IPFS_LOGGING to Docker image. (@lgierth)
- Fix dot path parsing on Windows. (@djdv)
- Fix formatting of
ipfs log ls
output. (@richardlitt)
- Fix
-
General Codebase
- Refactor Makefile. (@kevina)
- Wire context into bitswap requests more deeply. (@whyrusleeping)
- Use gx for iptb. (@chriscool)
- Update gx and gx-go. (@chriscool)
- Make blocks.Block an interface. (@kevina)
- Silence check for Docker existance. (@chriscool)
- Add dist_get script for fetching tools from dist.ipfs.io. (@whyrusleeping)
- Add proper defaults to all
ipfs
commands. (@richardlitt) - Remove dead
count
option fromipfs pin ls
. (@richardlitt) - Initialize pin mode strings only once. (@chriscool)
- Add changelog for v0.4.2. (@lgierth)
- Specify a dist.ipfs.io hash for tool downloads instead of trusting DNS. (@lgierth)
-
CI
- Fix t0170-dht sharness test. (@chriscool)
- Increase timeout in t0060-daemon sharness test. (@Kubuxu)
- Have CircleCI use
make deps
instead ofgx
directly. (@whyrusleeping)
This is a patch release that fixes a few bugs, and adds a few small (but not insignificant) features. The primary reason for this release is the listener hang bugfix that was shipped in the 0.4.0 release.
-
Features
- implementated ipfs object diff (@whyrusleeping)
- allow promises (used in get, refs) to fail (@whyrusleeping)
-
Tool changes
- Adds 'toolkit_upgrade' to the makefile help target (@achin)
-
General Codebase
- Use extracted go-libp2p-crypto, -secio, -peer packages (@lgierth)
- Update go-libp2p (@lgierth)
- Fix package manifest fields (@lgierth)
- remove incfusever dead-code (@whyrusleeping)
- remove a ton of unused godeps (@whyrusleeping)
- metrics: add prometheus back (@lgierth)
- clean up dead code and config fields (@whyrusleeping)
- Add log events when blocks are added/removed from the blockstore (@michealmure)
- repo: don't create logs directory, not used any longer (@lgierth)
-
Bugfixes
- fixed ipfs name resolve --local multihash error (@pfista)
- ipfs patch commands won't return null links field anymore (@whyrusleeping)
- Make non recursive resolve print the result (@Kubuxu)
- Output dirs on ipfs add -rn (@noffle)
- update libp2p dep to fix hanging listeners problem (@whyrusleeping)
- Fix Swarm.AddrFilters config setting with regard to
/ip6
addresses (@lgierth) - fix dht command key escaping (@whyrusleeping)
-
Testing
- Adds tests to make sure 'object patch' writes. (@noffle)
- small sharness test for promise failure checking (@whyrusleeping)
- sharness/Makefile: clean all BINS when cleaning (@chriscool)
-
Documentation
- Fix disconnect argument description (@richardlitt)
- Added a note about swarm disconnect (@richardlitt)
- Also fixed syntax for comment (@richardlitt)
- Alphabetized swarm subcmds (@richardlitt)
- Added note to ipfs stats bw interval option (@richardlitt)
- Small syntax changes to repo stat man (@richardlitt)
- update log command help text (@pfista)
- Added a long description to add (@richardlitt)
- Edited object patch set-data doc (@richardlitt)
- add roadmap.md (@Jeromy)
- Adds files api cmd to helptext (@noffle)
This is a major release with plenty of new features and bugfixes. It also includes breaking changes which make it incompatible with v0.3.x on the networking layer.
- Major Changes
- Multistream
- The addition of multistream is a breaking change on the networking layer, but gives IPFS implementations the ability to mix and match different stream multiplexers, e.g. yamux, spdystream, or muxado. This adds a ton of flexibility on one of the lower layers of the protocol, and will help us avoid further breaking protocol changes in the future.
- Files API
- The new
files
command and API allow a program to interact with IPFS using familiar filesystem operations, namely: creating directories, reading, writing, and deleting files, listing out different directories, and so on. This feature enables any other application that uses a filesystem-like backend for storage, to use IPFS as its storage driver without having change the application logic at all.
- The new
- Gx
- go-ipfs now uses gx to manage its
dependencies. This means that under the hood, go-ipfs's dependencies are
backed by IPFS itself! It also means that go-ipfs is no longer installed
using
go get
. Usemake install
instead.
- go-ipfs now uses gx to manage its
dependencies. This means that under the hood, go-ipfs's dependencies are
backed by IPFS itself! It also means that go-ipfs is no longer installed
using
- Multistream
- New Features
- Web UI
- Update to new version which is compatible with 0.4.0. (@dignifiedquire)
- Networking
- Implement uTP transport. (@whyrusleeping)
- Allow multiple addresses per configured bootstrap node. (@whyrusleeping)
- IPNS
- Improve IPNS resolution performance. (@whyrusleeping)
- Have dnslink prefer
TXT _dnslink.example.com
, allows usage of CNAME records. (@Kubuxu) - Prevent
ipfs name publish
when/ipns
is mounted. (@noffle)
- Repo
- Improve performance of
ipfs add
. (@whyrusleeping) - Add
Datastore.NoSync
config option for flatfs. (@rht) - Implement mark-and-sweep GC. (@whyrusleeping)
- Allow for GC during
ipfs add
. (@whyrusleeping) - Add
ipfs repo stat
command. (@tmg, @diasdavid)
- Improve performance of
- General
- Add support for HTTP OPTIONS requests. (@lidel)
- Add
ipfs diag cmds
to view active API requests (@whyrusleeping) - Add an
IPFS_LOW_MEM
environment veriable which relaxes Bitswap's memory usage. (@whyrusleeping) - The Docker image now lives at
ipfs/go-ipfs
and has been completely reworked. (@lgierth)
- Web UI
- Security fixes
- The gateway path prefix added in v0.3.10 was vulnerable to cross-site
scripting attacks. This release introduces a configurable list of allowed
path prefixes. It's called
Gateway.PathPrefixes
and takes a list of strings, e.g.["/blog", "/foo/bar"]
. The v0.3.x line will not receive any further updates, so please update to v0.4.0 as soon as possible. (@lgierth)
- The gateway path prefix added in v0.3.10 was vulnerable to cross-site
scripting attacks. This release introduces a configurable list of allowed
path prefixes. It's called
- Incompatible Changes
- Install using
make install
instead ofgo get
(@whyrusleeping) - Rewrite pinning to store pins in IPFS objects. (@tv42)
- Bump fs-repo version to 3. (@whyrusleeping)
- Use multistream muxer (@whyrusleeping)
- The default for
--type
inipfs pin ls
is nowall
. (@chriscool)
- Install using
- Bug Fixes
- Remove msgio double wrap. (@jbenet)
- Buffer msgio. (@whyrusleeping)
- Perform various fixes to the FUSE code. (@tv42)
- Compute
ipfs add
size in background to not stall add operation. (@whyrusleeping) - Add option to have
ipfs add
include top-level hidden files. (@noffle) - Fix CORS checks on the API. (@rht)
- Fix
ipfs update
error message. (@tomgg) - Resolve paths in
ipfs pin rm
without network lookup. (@noffle) - Detect FUSE unmounts and track mount state. (@noffle)
- Fix go1.6rc2 panic caused by CloseNotify being called from wrong goroutine. (@rwcarlsen)
- Bump DHT kvalue from 10 to 20. (@whyrusleeping)
- Put public key and IPNS entry to DHT in parallel. (@whyrusleeping)
- Fix panic in CLI argument parsing. (@whyrusleeping)
- Fix range error by using larger-than-zero-length buffer. (@noffle)
- Fix yamux hanging issue by increasing AcceptBacklog. (@whyrusleeping)
- Fix double Transport-Encoding header bug. (@whyrusleeping)
- Fix uTP panic and file descriptor leak. (@whyrusleeping)
- Tool Changes
- Add
--pin
option toipfs add
, which defaults totrue
and allows--pin=false
. (@eminence) - Add arguments to
ipfs pin ls
. (@chriscool) - Add
dns
andresolve
commands to read-only API. (@Kubuxu) - Add option to display headers for
ipfs object links
. (@palkeo)
- Add
- General Codebase Changes
- Check Golang version in Makefile. (@chriscool)
- Improve Makefile. (@tomgg)
- Remove dead Jenkins CI code. (@lgierth)
- Add locking interface to blockstore. (@whyrusleeping)
- Add Merkledag FetchGraph and EnumerateChildren. (@whyrusleeping)
- Rename Lock/RLock to GCLock/PinLock. (@jbenet)
- Implement pluggable datastore types. (@tv42)
- Record datastore metrics for non-default datastores. (@tv42)
- Allow multistream to have zero-rtt stream opening. (@whyrusleeping)
- Refactor
ipnsfs
into a more generic and well testedmfs
. (@whyrusleeping) - Grab more peers if bucket doesn't contain enough. (@whyrusleeping)
- Use CloseNotify in gateway. (@whyrusleeping)
- Flatten multipart file transfers. (@whyrusleeping)
- Send updated DHT record fixes to peers who sent outdated records. (@whyrusleeping)
- Replace go-psutil with go-sysinfo. (@whyrusleeping)
- Use ServeContent for index.html. (@AtnNn)
- Refactor
object patch
API to not store data in URL. (@whyrusleeping) - Use mfs for
ipfs add
. (@whyrusleeping) - Add
Server
header to API responses. (@Kubuxu) - Wire context directly into HTTP requests. (@rht)
- Wire context directly into GetDAG operations within GC. (@rht)
- Vendor libp2p using gx. (@whyrusleeping)
- Use gx vendored packages instead of Godeps. (@whyrusleeping)
- Simplify merkledag package interface to ease IPLD inclusion. (@mildred)
- Add default option value support to commands lib. (@whyrusleeping)
- Refactor merkledag fetching methods. (@whyrusleeping)
- Use net/url to escape paths within Web UI. (@noffle)
- Deprecated key.Pretty(). (@MichealMure)
- Documentation
- Fix and update help text for every
ipfs
command. (@RichardLitt) - Change sample API origin settings from wildcard (
*
) toexample.com
. (@Kubuxu) - Improve documentation of installation process in README. (@whyrusleeping)
- Improve windows.md. (@chriscool)
- Clarify instructions for installing from source. (@noffle)
- Make version checking more robust. (@jedahan)
- Assert the source code is located within GOPATH. (@whyrusleeping)
- Remove mentions of
/dns
fromipfs dns
command docs. (@lgierth)
- Fix and update help text for every
- Testing
- Refactor iptb tests. (@chriscool)
- Improve t0240 sharness test. (@chriscool)
- Make bitswap tests less flaky. (@whyrusleeping)
- Use TCP port zero for ipfs daemon in sharness tests. (@whyrusleeping)
- Improve sharness tests on AppVeyor. (@chriscool)
- Add a pause to fix timing on t0065. (@whyrusleeping)
- Add support for arbitrary TCP ports to t0060-daemon.sh. (@noffle)
- Make t0060 sharness test use TCP port zero. (@whyrusleeping)
- Randomized ipfs stress testing via randor (@dignifiedquire)
- Stress test pinning and migrations (@whyrusleeping)
This is the final ipfs version before the transition to v0.4.0. It introduces a few stability improvements, bugfixes, and increased test coverage.
-
Features
- Add 'get' and 'patch' to the allowed gateway commands (@whyrusleeping)
- Updated webui version (@dignifiedquire)
-
BugFixes
- Fix path parsing for add command (@djdv)
- namesys: Make paths with multiple segments work. Fixes #2059 (@Kubuxu)
- Fix up panic catching in http handler funcs (@whyrusleeping)
- Add correct access control headers to the default api config (@dignifiedquire)
- Fix closenotify by not sending empty file set (@whyrusleeping)
-
Tool Changes
- Have install.sh use the full path to ipfs binary if detected (@jedahan)
- Install daemon system-wide if on El Capitan (@jedahan)
- makefile: add -ldflags to install and nofuse tasks (@lgierth)
-
General Codebase
- Clean up http client code (@whyrusleeping)
- Move api version check to header (@rht)
-
Documentation
- Improved release checklist (@jbenet)
- Added quotes around command in long description (@RichardLitt)
- Added a shutdown note to daemon description (@RichardLitt)
-
Testing
- t0080: improve last tests (@chriscool)
- t0080: improve 'ipfs refs --unique' test (@chriscool)
- Fix t.Fatal usage in goroutines (@chriscool)
- Add docker testing support to sharness (@chriscool)
- sharness: add t0300-docker-image.sh (@chriscool)
- Included more namesys tests. (@Kubuxu)
- Add sharness test to verify requests look good (@whyrusleeping)
- Re-enable ipns sharness test now that iptb is fixed (@whyrusleeping)
- Force use of ipv4 in test (@whyrusleeping)
- Travis-CI: use go 1.5.2 (@jbenet)
This patch update introduces the 'ipfs update' command which will be used for future ipfs updates along with a few other bugfixes and documentation improvements.
-
Features
- support for 'ipfs update' to call external binary (@whyrusleeping)
- cache ipns entries to speed things up a little (@whyrusleeping)
- add option to version command to print repo version (@whyrusleeping)
- Add in some more notifications to help profile queries (@whyrusleeping)
- gateway: add path prefix for directory listings (@lgierth)
- gateway: add CurrentCommit to /version (@lgierth)
-
BugFixes
- set data and links nil if not present (@whyrusleeping)
- fix log hanging issue, and implement close-notify for commands (@whyrusleeping)
- fix dial backoff (@whyrusleeping)
- proper ndjson implementation (@whyrusleeping)
- seccat: fix secio context (@lgierth)
- Add newline to end of the output for a few commands. (@nham)
- Add fixed period repo GC + test (@rht)
-
Tool Changes
- Allow
ipfs cat
on ipns path (@rht)
- Allow
-
General Codebase
- rewrite of backoff mechanism (@whyrusleeping)
- refactor net code to use transports, in rough accordance with libp2p (@whyrusleeping)
- disable building fuse stuff on windows (@whyrusleeping)
- repo: remove Log config (@lgierth)
- commands: fix description of --api (@lgierth)
-
Documentation
- --help: Add a note on using IPFS_PATH to the footer of the helptext. (@sahib)
- Moved email juan to ipfs/contribute (@richardlitt)
- Added commit sign off section (@richardlitt)
- Added a security section (@richardlitt)
- Moved TODO doc to issue #1929 (@richardlitt)
-
Testing
- gateway: add tests for /version (@lgierth)
- Add gc auto test (@rht)
- t0020: cleanup dir with bad perms (@chriscool)
Note: this commit introduces fixed-period repo gc, which will trigger gc
after a fixed period of time. This feature is introduced now, disabled by
default, and can be enabled with ipfs daemon --enable-gc
. If all goes well,
in the future, it will be enabled by default.
This patch update includes a good number of bugfixes, notably, it fixes builds on windows, and puts newlines between streaming json objects for a proper nsjon format.
-
Features
- Writable gateway enabled again (@cryptix)
-
Bugfixes
- fix windows builds (@whyrusleeping)
- content type on command responses default to text (@whyrusleeping)
- add check to makefile to ensure windows builds dont fail silently (@whyrusleeping)
- put newlines between streaming json output objects (@whyrusleeping)
- fix streaming output to flush per write (@whyrusleeping)
- purposely fail builds pre go1.5 (@whyrusleeping)
- fix ipfs id (@whyrusleeping)
- fix a few race conditions in mocknet (@whyrusleeping)
- fix makefile failing when not in a git repo (@whyrusleeping)
- fix cli flag orders (long, short) (@rht)
- fix races in http cors (@miolini)
- small webui update (some bugfixes) (@jbenet)
-
Tool Changes
- make swarm connect return an error when it fails (@whyrusleeping)
- Add short flag for
ipfs ls --headers
(v for verbose) (@rht)
-
General Codebase
- bitswap: clean log printf and humanize dup data count (@cryptix)
- config: update pluto's peerID (@lgierth)
- config: update bootstrap list hostname (@lgierth)
-
Documentation
- Pared down contribute to link to new go guidelines (@richardlitt)
-
Testing
- t0010: add tests for 'ipfs commands --flags' (@chriscool)
- ipns_test: fix namesys.NewNameSystem() call (@chriscool)
- t0060: fail if no nc (@chriscool)
This patch update includes changes to make ipns more consistent and reliable, symlink support in unixfs, mild performance improvements, new tooling features, a plethora of bugfixes, and greatly improved tests.
NOTICE: Version 0.3.8 also requires golang version 1.5.1 or higher.
-
Bugfixes
- refactor ipns to be more consistent and reliable (@whyrusleeping)
- fix 'ipfs refs' json output (@whyrusleeping)
- fix setting null config maps (@rht)
- fix output of dht commands (@whyrusleeping)
- fix NAT spam dialing (@whyrusleeping)
- fix random panics on 32 bit systems (@whyrusleeping)
- limit total number of network fd's (@whyrusleeping)
- fix http api content type (@WeMeetAgain)
- fix writing of api file for port zero daemons (@whyrusleeping)
- windows connection refused fixes (@mjanczyk)
- use go1.5's built in trailers, no more failures (@whyrusleeping)
- fix random bitswap hangs (@whyrusleeping)
- rate limit fd usage (@whyrusleeping)
- fix panic in bitswap ratelimiting (@whyrusleeping)
-
Tool Changes
- --empty-repo option for init (@prusnak)
- implement symlinks (@whyrusleeping)
- improve cmds lib files processing (@rht)
- properly return errors through commands (@whyrusleeping)
- bitswap unwant command (@whyrusleeping)
- tar add/cat commands (@whyrusleeping)
- fix gzip compression in get (@klauspost)
- bitswap stat logs wasted bytes (@whyrusleeping)
- resolve command now uses core.Resolve (@rht)
- add
--local
flag to 'name resolve' (@whyrusleeping) - add
ipfs diag sys
command for debugging help (@whyrusleeping)
-
General Codebase
- improvements to dag editor (@whyrusleeping)
- swarm IPv6 in default config (Baptiste Jonglez)
- improve dir listing css (@rht)
- removed elliptic.P224 usage (@prusnak)
- improve bitswap providing speed (@jbenet)
- print panics that occur in cmds lib (@whyrusleeping)
- ipfs api check test fixes (@rht)
- update peerstream and datastore (@whyrusleeping)
- cleaned up tar-reader code (@jbenet)
- write context into coreunix.Cat (@rht)
- move assets to separate repo (@rht)
- fix proc/ctx wiring in bitswap (@jbenet)
- rabin fingerprinting chunker (@whyrusleeping)
- better notification on daemon ready (@rht)
- coreunix cat cleanup (@rht)
- extract logging into go-log (@whyrusleeping)
- blockservice.New no longer errors (@whyrusleeping)
- refactor ipfs get (@rht)
- readonly api on gateway (@rht)
- cleanup context usage all over (@rht)
- add xml decoding to 'object put' (@ForrestWeston)
- replace nodebuilder with NewNode method (@whyrusleeping)
- add metrics to http handlers (@lgierth)
- rm blockservice workers (@whyrusleeping)
- decompose maybeGzWriter (@rht)
- makefile sets git commit sha on build (@CaioAlonso)
-
Documentation
- add contribute file (@RichardLitt)
- add go devel guide to contribute.md (@whyrusleeping)
-
Testing
- fix mock notifs test (@whyrusleeping)
- test utf8 with object cmd (@chriscool)
- make mocknet conn close idempotent (@jbenet)
- fix fuse tests (@pnelson)
- improve sharness test quoting (@chriscool)
- sharness tests for chunker and add-cat (@rht)
- generalize peerid check in sharness (@chriscool)
- test_cmp argument cleanup (@chriscool)
This patch update fixes a problem we introduced in 0.3.6 and did not catch: the webui failed to work with out-of-the-box CORS configs. This has been fixed and now should work correctly. @jbenet
This patch improves the resource consumption of go-ipfs, introduces a few new options on the CLI, and also fixes (yet again) windows builds.
-
Resource consumption:
- fixed goprocess memory leak @rht
- implement batching on datastore @whyrusleeping
- Fix bitswap memory leak @whyrusleeping
- let bitswap ignore temporary write errors @whyrusleeping
- remove logging to disk in favor of api endpoint @whyrusleeping
- --only-hash option for add to skip writing to disk @whyrusleeping
-
Tool changes
- improved
ipfs daemon
output with all addresses @jbenet - improved
ipfs id -f
output, added<addrs>
and\n \t
support @jbenet ipfs swarm addrs local
now shows the local node's addrs @jbenet- improved config json parsing @rht
- improved Dockerfile to use alpine linux @Luzifer @lgierth
- improved bash completion @MichaelMure
- Improved 404 for gateway @cryptix
- add unixfs ls to list correct filesizes @wking
- ignore hidden files by default @gatesvp
- global --timeout flag @whyrusleeping
- fix random API failures by closing resp bodies @whyrusleeping
- ipfs swarm filters @whyrusleeping
- api returns errors in http trailers @whyrusleeping @jbenet
ipfs patch
learned to create intermediate nodes @whyrusleepingipfs object stat
now shows Hash @whyrusleepingipfs cat
now clears progressbar on exit @rhtipfs add -w -r <dir>
now wraps directories @jbenetipfs add -w <file1> <file2>
now wraps with one dir @jbenet- API + Gateway now support arbitrary HTTP Headers from config @jbenet
- API now supports CORS properly from config @jbenet
- Deprecated:
API_ORIGIN
env var (use config, seeipfs daemon --help
) @jbenet
- improved
-
General Codebase
nofuse
tag for windows @Luzifer- improved
ipfs add
code @gatesvp - started requiring license trailers @chriscool @jbenet
- removed CtxCloser for goprocess @rht
- remove deadcode @lgierth @whyrusleeping
- reduced number of logging libs to 2 (soon to be 1) @rht
- dial address filtering @whyrusleeping
- prometheus metrics @lgierth
- new index page for gateway @krl @cryptix
- move ping to separate protocol @whyrusleeping
- add events to bitswap for a dashboard @whyrusleeping
- add latency and bandwidth options to mocknet @heems
- levenshtein distance cmd autosuggest @sbruce
- refactor/cleanup of cmds http handler @whyrusleeping
- cmds http stream reports errors in trailers @whyrusleeping
-
Bugfixes
- fixed path resolution and validation @rht
- fixed
ipfs get -C
output and progress bar @rht - Fixed install pkg dist bug @jbenet @Luzifer
- Fix
ipfs get
silent failure @whyrusleeping ipfs get
tarx no longer times out @jbenetipfs refs -r -u
is now correct @gatesvp- Fix
ipfs add -w -r <dir>
wrapping bugs @jbenet - Fixed FUSE unmount failures @jbenet
- Fixed
ipfs log tail
command (api + cli) @whyrusleeping
-
Testing
- sharness updates @chriscool
- ability to disable secio for testing @jbenet
- fixed many random test failures, more reliable CI @whyrusleeping
- Fixed racey notifier failures @whyrusleeping
ipfs refs -r -u
test cases @jbenet- Fix failing pinning test @jbenet
- Better CORS + Referer tests @jbenet
- Added reversible gc test @rht
- Fixed bugs in FUSE IPNS tests @whyrusleeping
- Fixed bugs in FUSE IPFS tests @jbenet
- Added
random-files
tool for easier sharness tests @jbenet
-
Documentation
- Add link to init system examples @slang800
- Add CORS documentation to daemon init @carver (Note: this will change soon)
This patch improves overall stability and performance
- added 'object patch' and 'object new' commands @whyrusleeping
- improved symmetric NAT avoidance @jbenet
- move util.Key to blocks.Key @whyrusleeping
- fix memory leak in provider store @whyrusleeping
- updated webui to 0.2.0 @krl
- improved bitswap performance @whyrusleeping
- update fuse lib @cryptix
- fix path resolution @wking
- implement test_seq() in sharness @chriscool
- improve parsing of stdin for commands @chriscool
- fix 'ipfs refs' failing silently @whyrusleeping
- fix serial dialing bug @jbenet
- improved testing @chriscool @rht @jbenet
- fixed domain resolving @luzifer
- fix parsing of unwanted stdin @lgierth
- added CORS handlers to gateway @NodeGuy
- added
ipfs daemon --unrestricted-api
option @krl - general cleanup of dependencies
- fix ipns append bug @whyrusleeping
- fix out of memory panic @whyrusleeping
- add in expvar metrics @tv42
- bitswap improvements @whyrusleeping
- fix write-cache in blockstore @tv42
- vendoring cleanup @cryptix
- added
launchctl
plist for OSX @grncdr - improved Dockerfile, changed root and mount paths @ehd
- improved
pin ls
output to show types @vitorbaptista
This patch update fixes various issues, in particular:
- windows support (0.3.0 had broken it)
- commandline parses spaces correctly.
- much improved commandline parsing by @AtnNn
- improved dockerfile by @luzifer
- add cmd cleanup by @wking
- fix flatfs windows support by @tv42 and @gatesvp
- test case improvements by @chriscool
- ipns resolution timeout bug fix by @whyrusleeping
- new cluster tests with iptb by @whyrusleeping
- fix log callstack printing bug by @whyrusleeping
- document bash completiong by @dylanPowers
This patch update implements multicast dns as well as fxing a few test issues.
- implment mdns peer discovery @whyrusleeping
- fix mounting issues in sharness tests @chriscool
This patch update fixes a few bugs:
- harden shutdown logic by @torarnv
- daemon locking fixes by @travisperson
- don't re-add entire dirs by @whyrusleeping
- tests now wait for graceful shutdown by @jbenet
- default key size is now 2048 by @jbenet
We've just released version 0.3.0, which contains many performance improvements, bugfixes, and new features. Perhaps the most noticeable change is moving block storage from leveldb to flat files in the filesystem.
What to expect:
-
much faster performance
-
Repo format 2
- moved default location from ~/.go-ipfs -> ~/.ipfs
- renamed lock filename daemon.lock -> repo.lock
- now using a flat-file datastore for local blocks
-
Fixed lots of bugs
- proper ipfs-path in various commands
- fixed two pinning bugs (recursive pins)
- increased yamux streams window (for speed)
- increased bitswap workers (+ env var)
- fixed memory leaks
- ipfs add error returns
- daemon exit bugfix
- set proper UID and GID on fuse mounts
-
Gateway
- Added support for HEAD requests
-
configuration
- env var to turn off SO_REUSEPORT: IPFS_REUSEPORT=false
- env var to increase bitswap workers: IPFS_BITSWAP_TASK_WORKERS=n
-
other
- bash completion is now available
- ipfs stats bw -- bandwidth meetering
And many more things.
- Alpha Release
-
bootstrap addresses now have .../ipfs/... in format config file Bootstrap field changed accordingly. users can upgrade cleanly with:
ipfs bootstrap >boostrap_peers ipfs bootstrap rm --all <install new ipfs> <manually add .../ipfs/... to addrs in bootstrap_peers> ipfs bootstrap add <bootstrap_peers