SystemUpdateAsync causes "Property ListId was not loaded"

[berntrune]

I am trying to update Modifed field using PNP SystemUpdateAsync.
When using UpdateAsync, all normal item fields are stored successfully (except Modified of course).
When changing to SystemUpdateAsync I get "Property ListId was not yet loaded". (see stack trace below)

using (var ctx = await _pnpContextFactory.CreateAsync(new Uri("http://site")))
{
var doc = await ctx.Web.Lists.GetByTitleAsync("Documents");
var file = await doc.RootFolder.Files.AddAsync("file.docx", fileStream, true);
file.ListItemAllFields["Title"] = "new title";
file.ListItemAllFields["Modified"] = DateTime.Now;
//await file.ListItemAllFields.UpdateAsync();
await file.ListItemAllFields.SystemUpdateAsync();
}

at PnP.Core.Model.TransientObject.GetValue[T](String propertyName)
at PnP.Core.Model.SharePoint.File.get_ListId()
at PnP.Core.Model.SharePoint.ListItem.d__80.MoveNext()
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at PnP.Core.Model.SharePoint.ListItem.d__83.MoveNext()
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.GetResult()
at LargeFileTransfer.TransferFile.d__3.MoveNext() in C:\DevopsGit\Bikube.Azure.Services.BergenFunction\TransferFile.cs:line 109

Normally, in csom, I've been able to swap these methods without any issues.
Any clues?

[jansenbe]

@berntrune : this seems to be an issue, let's track via #570