ProjectLibre failing because of SourceforgeURLProvider

[fuzzylogiq]

Getting the following when running ProjectLibre.munki (overridden):

Processing ProjectLibre.munki.recipe...

The following recipes failed:
ProjectLibre.munki.recipe
Error in local.munki.ProjectLibre: Processor: com.github.jessepeterson.munki.GrandPerspective/SourceForgeURLProvider: Error: Could not retrieve RSS feed http://sourceforge.net/api/file/index/project-id/715892/rss

Nothing downloaded, packaged or imported.

I think this is because you're using urllib2 and sourceforge have changed to redirect the original url somewhere else. You could possibly shell out to curl and use -L/--location but I did not want to be presumptuous!

Ben

[orbsmiv]

I've been picking at this too and SourceForge have indeed restructured so that (I think) it's no longer necessary to derive the Project ID and the files RSS feed can now be found using the following URL:

https://sourceforge.net/projects/%s/rss

... where %s is the project name, as per the SourceForgeURLProvider processor.

Could the urllib2 issue be the same one that recently stung AutoPkg itself (re Github), i.e. that SourceForge now requires a newer version of TLS? If this is the case then the curl refactoring will probably be necessary.

[jessepeterson]

I'd need to see the full traceback from Python to make a better determination. Looks like we're hiding errors with exception catching.

[orbsmiv]

I've been unpicking this again recently and it is indeed related to the version of OpenSSL (and therefore TLS) running on the system, which urllib2 is leveraging. I was running AutoPkg on an older box but the issues disappeared when I migrated AutoPkg to a 10.13.6 system.

Here's a quick line to check which version of TLS urllib2 is using:

python -c "import urllib2,json; print(json.loads(urllib2.urlopen('https://www.howsmyssl.com/a/check').read())['tls_version'])"

(TLS 1.0 is now insufficient for SourceForge.)

[xastherion]

Yes, a big piece of the problem with SourceforgeURLProvider stay in TLS. But another in the way how Sourceforge have the adresses to the software.

in a mac with 10.12 and TLS 1.0:
I try to run my override of GrandPerspective and bekome:

autopkg run grandperspective.munki
Processing grandperspective.munki...
Could not retrieve RSS feed http://sourceforge.net/api/file/index/project-id/148156/rss
Failed.

The following recipes failed:
    grandperspective.munki
        Error in local.munki.grandperspective: Processor: com.github.jessepeterson.munki.GrandPerspective/SourceForgeURLProvider: Error: Could not retrieve RSS feed http://sourceforge.net/api/file/index/project-id/148156/rss

Nothing downloaded, packaged or imported.

With burn.munki, the SourceForgeURLProvider use, i become some similar output:

autopkg run -v burn.munki
Processing burn.munki...
com.github.jessepeterson.munki.GrandPerspective/SourceForgeURLProvider
Could not retrieve RSS feed http://sourceforge.net/api/file/index/project-id/169226/rss
Failed.
Receipt written to /DATA/AutoPkg/Cache/local.munki.Burn/receipts/burn-receipt-20190815-132341.plist

The following recipes failed:
    burn.munki
        Error in local.munki.Burn: Processor: com.github.jessepeterson.munki.GrandPerspective/SourceForgeURLProvider: Error: Could not retrieve RSS feed http://sourceforge.net/api/file/index/project-id/169226/rss
Nothing downloaded, packaged or imported.

But anotherwise, in a Mac with 10.14 and TLS 1.2 the ouput is better:

autopkg run grandperspective.munki
Processing grandperspective.munki...
The following new items were imported into Munki:
    Name              Version  Catalogs     Pkginfo Path                                   Pkg Repo Path
    ----              -------  --------     ------------                                   -------------
    GrandPerspective  2.2.2    all,testing  GrandPerspective/GrandPerspective-2.2.2.plist  GrandPerspective/GrandPerspective-2.2.2.dmg

unfortunately with "Burn" i don´t have still success and i have this result:

autopkg run -vv burn.munki
Processing burn.munki...
com.github.jessepeterson.munki.GrandPerspective/SourceForgeURLProvider
{'Input': {'SOURCEFORGE_FILE_PATTERN': u'burn.*?-64bit.zip',
           'SOURCEFORGE_PROJECT_ID': 169226L}}
No matched files
Failed.
Receipt written to ~/Library/AutoPkg/Cache/local.munki.burn/receipts/burn-receipt-20190815-150246.plist
The following recipes failed:
    burn.munki
        Error in local.munki.burn: Processor: com.github.jessepeterson.munki.GrandPerspective/SourceForgeURLProvider: Error: No matched files
Nothing downloaded, packaged or imported.

Here is the problem again with these keys in burn.download.recipe:
SOURCEFORGE_FILE_PATTERN
SOURCEFORGE_PROJECT_ID
When i compare this with the from GrandPerspective, i see that some update in SourceForge change ID with NAME, i will try to repair this later, or if somebody can give me the solution i will thank you.