Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Getting org.neo4j.kernel.impl.store.InvalidRecordException: DynamicRecord error in import #2

Open
kigster opened this issue Jan 8, 2022 · 0 comments

Comments

@kigster
Copy link

kigster commented Jan 8, 2022

Steps to reproduce:

  1. Follow the README and install the latest neo4j version 4+

  2. Attempt to import using the modified command:

    $NEO4J_HOME/neo4j-admin import                  \    # --force (if the db file exists) 
        --database=imdb                             \
        --nodes=Movie=./imdb-data/movies.csv        \
        --nodes=Actor=./imdb-data/actors.csv        \
        --relationships=./imdb-data/roles.csv
  3. Observe the error:

    (1/4) Node import 2022-01-07 16:30:19.993-0800
      Estimated number of nodes: 2.65 M
      Estimated disk space usage: 164.2MiB
      Estimated required memory usage: 72.99MiB
    .......... .......... .......... .......... ..........   5% ∆4s 688ms
    .......... .......... .......... .......... ..........  10% ∆3ms
    .......... .......... .......-.. .......... ..........  15% ∆201ms
    .......... .......... .......... .......... ..........  20% ∆0ms
    .......... .......... .......... .......... ..........  25% ∆1ms
    .......... .......... .......... .......... ..........  30% ∆402ms
    .......... .......... .......... .......... ..........  35% ∆0ms
    .......... .......... .......... .......... ..........  40% ∆0ms
    .......... .......... .......... .......... ..........  45% ∆0ms
    .......... .......... .......... .......... ...Critical error occurred! Shutting down the import...
    .......  50% ∆127ms
    .......... .......... .......... .......... ..........  55% ∆0ms
    .......... .......... .......... .......... ..........  60% ∆0ms
    .......... .......... .......... .......... ..........  65% ∆0ms
    .......... .......... .......... .......... ..........  70% ∆0ms
    .......... .......... .......... .......... ..........  75% ∆0ms
    .......... .......... .......... .......... ..........  80% ∆1ms
    .......... .......... .......... .......... ..........  85% ∆0ms
    .......... .......... .......... .......... ..........  90% ∆0ms
    .......... .......... .......... .......... ..........  95% ∆0ms
    .......... .......... .......... .......... .......... 100% ∆0ms
    
    Node import COMPLETED in 5s 713ms
    
    
    IMPORT FAILED in 6s 265ms.
    Data statistics is not available.
    Peak memory usage: 62.58MiB
    Import error: DynamicRecord[45631,used=false,(0),type=-1,data=byte[],start=true,next=-1] not in use
    Caused by:DynamicRecord[45631,used=false,(0),type=-1,data=byte[],start=true,next=-1] not in use
    org.neo4j.kernel.impl.store.InvalidRecordException: DynamicRecord[45631,used=false,(0),type=-1,data=byte[],start=true,next=-1] not in use
        at org.neo4j.kernel.impl.store.record.RecordLoad.verify(RecordLoad.java:141)
        at org.neo4j.kernel.impl.store.CommonAbstractStore.verifyAfterNotRead(CommonAbstractStore.java:1041)
        at org.neo4j.kernel.impl.store.CommonAbstractStore.readIntoRecord(CommonAbstractStore.java:854)
        at org.neo4j.kernel.impl.store.CommonAbstractStore.getRecordByCursor(CommonAbstractStore.java:830)
        at org.neo4j.kernel.impl.store.CommonAbstractStore.streamRecords(CommonAbstractStore.java:1003)
        at org.neo4j.kernel.impl.store.CommonAbstractStore.getRecords(CommonAbstractStore.java:979)
        at org.neo4j.kernel.impl.store.PropertyStore.ensureHeavy(PropertyStore.java:300)
        at org.neo4j.kernel.impl.store.PropertyStore.getTextValueFor(PropertyStore.java:700)
        at org.neo4j.kernel.impl.store.PropertyType$9.value(PropertyType.java:129)
        at org.neo4j.kernel.impl.store.record.PropertyBlock.newPropertyValue(PropertyBlock.java:280)
        at org.neo4j.internal.batchimport.NodeInputIdPropertyLookup.lookupProperty(NodeInputIdPropertyLookup.java:59)
        at org.neo4j.internal.batchimport.cache.idmapping.string.EncodingIdMapper.buildCollisionInfo(EncodingIdMapper.java:527)
        at org.neo4j.internal.batchimport.cache.idmapping.string.EncodingIdMapper.prepare(EncodingIdMapper.java:263)
        at org.neo4j.internal.batchimport.IdMapperPreparationStep.process(IdMapperPreparationStep.java:54)
        at org.neo4j.internal.batchimport.staging.LonelyProcessingStep.lambda$receive$0(LonelyProcessingStep.java:53)
        at java.base/java.lang.Thread.run(Thread.java:829)
    
    WARNING Import failed. The store files in /usr/local/var/neo4j/data/databases/imdb are left as they are, although they are likely in an unusable state. Starting a database on these store files will likely fail or observe inconsistent records so start at your own risk or delete the store manually
    org.neo4j.kernel.impl.store.InvalidRecordException: DynamicRecord[45631,used=false,(0),type=-1,data=byte[],start=true,next=-1] not in use
        at org.neo4j.kernel.impl.store.record.RecordLoad.verify(RecordLoad.java:141)
        at org.neo4j.kernel.impl.store.CommonAbstractStore.verifyAfterNotRead(CommonAbstractStore.java:1041)
        at org.neo4j.kernel.impl.store.CommonAbstractStore.readIntoRecord(CommonAbstractStore.java:854)
        at org.neo4j.kernel.impl.store.CommonAbstractStore.getRecordByCursor(CommonAbstractStore.java:830)
        at org.neo4j.kernel.impl.store.CommonAbstractStore.streamRecords(CommonAbstractStore.java:1003)
        at org.neo4j.kernel.impl.store.CommonAbstractStore.getRecords(CommonAbstractStore.java:979)
        at org.neo4j.kernel.impl.store.PropertyStore.ensureHeavy(PropertyStore.java:300)
        at org.neo4j.kernel.impl.store.PropertyStore.getTextValueFor(PropertyStore.java:700)
        at org.neo4j.kernel.impl.store.PropertyType$9.value(PropertyType.java:129)
        at org.neo4j.kernel.impl.store.record.PropertyBlock.newPropertyValue(PropertyBlock.java:280)
        at org.neo4j.internal.batchimport.NodeInputIdPropertyLookup.lookupProperty(NodeInputIdPropertyLookup.java:59)
        at org.neo4j.internal.batchimport.cache.idmapping.string.EncodingIdMapper.buildCollisionInfo(EncodingIdMapper.java:527)
        at org.neo4j.internal.batchimport.cache.idmapping.string.EncodingIdMapper.prepare(EncodingIdMapper.java:263)
        at org.neo4j.internal.batchimport.IdMapperPreparationStep.process(IdMapperPreparationStep.java:54)
        at org.neo4j.internal.batchimport.staging.LonelyProcessingStep.lambda$receive$0(LonelyProcessingStep.java:53)
        at java.base/java.lang.Thread.run(Thread.java:829)
    

Version Information

>  neo4j-admin --version
4.4.2

> neo4j-admin store-info --all /usr/local/var/neo4j/data/databases
Selecting JVM - Version:11.0.12+0, Name:OpenJDK 64-Bit Server VM, Vendor:Homebrew
Database name:                imdb
Database in use:              false
Store format version:         AF4.3.0
Store format introduced in:   4.3.0
Last committed transaction id:1
Store needs recovery:         true

Database name:                neo4j
Database in use:              false
Store format version:         AF4.3.0
Store format introduced in:   4.3.0
Last committed transaction id:1
Store needs recovery:         true
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant