Wip/martyn/t6435

See merge request !1

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

Extend README.md with a description of each of the python scripts
available in this repository.

Signed-off-by: Martyn Welch <martyn.welch@collabora.co.uk>

Signed-off-by: Martyn Welch <martyn.welch@collabora.co.uk>

Add 3 more helper scripts:

check_links.py:       Check links are properly formatted and ensure that
                      internal links use {{< ref "foo.md" >}} macro which
                      aids in protecting against broken links.
move_page.py:         Moves page and checks for any links that need to
                      change.
remove_dead_links.py: Remove links with given patterns that are known to
                      be broken.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

This script is used to sort out redirects for the old test cases to
qa.apertis.org.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

Add script to move release data (release notes, release schedules, test
reports) to better locations.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

Add a script to find pages not accessible from the homepage.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

A few issues were found with the script when running through steps with
latest data:

 - A few extra placeholder pages needed creating
 - The resolve_redirects.py script needed plumbing in properly

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

Add a README.md containing instructions for converting Mediawiki to Hugo.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

A number of extra scripts have been written to aid in the conversion
between mediawiki and hugo. As these scripts.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

This repo is going to hold extra scripts that have been created during the
provess of moving from the mediawiki to hugo, put mediawiki-to-markdown
into a subdirectory to make the distinction between the tools cleaner.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

So as to transition relatively seemlessly to the new site, we can use the
Hugo Alias functionality to put a number of HTML redirects in place to
translate between `/old-wiki/<original_link>` and the new page location.

We are hoping to combine this with URL rewriting on wiki.apertis.org to
redirect requests for pages formerly served there into the redirect
structure.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

We are now not planning to use the syna theme, the "fragment" key in the
page frontmatter is a specific syna tweak. Remove it.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

Link handling was braking when changing baseurl. Improve method used to
modify the links to make it more robust.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

The conversion from Mediawiki to Markdown currently doesn't do a good job
when it comes to links and images. Improve the conversion for our use
case, of moving from Mediawiki to Hugo.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

The format "markdown-github" is deprecated in favour of "gfm". Using the
former results in warning messages during processing. Switch to "gfm".

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

If the mediawiki dump is performed a way that captures all historic
versions of a page, using the first revision in the XML appears to end
up using the oldest version of the page, discarding newer versions,
which is unlikely to be what the user expects.

Pick the last version of the page returned.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

It is possible for the mediawiki page title to contain forward slashes that
would need to be converted to directories when converting to markdown. For
example, when presented with the page "foo/bar", we'd expect this to result in
a file called "bar.md" in the directory "foo/". Currently the directory "foo/"
is not being created, resulting in "bar.md" failing to be created.

Tweak the directory parsing to ensure all required directories are created.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

normalize path before writing, partly fixes #2

See https://github.com/philipashlock/mediawiki-to-markdown/issues/2
for an explanation of what can go wrong

This doesn't yet support rewriting from MediaWiki piped link syntax