Improve flexibility of Datafile when transferring between datasets

[thclark]

Feature request

Use Case

@thclark to come back and populate issue later

        # TODO REFACTOR REQUEST This code works around the problem experienced when downloading one datfile
        # multiple times. To avoid repeat work, the Datafile class will only download once then it remembers
        # that it's been downloaded. This is usually useful, but in this particular case where we want to duplicate
        # a single input file to many new datasets, it only downloads the file to the first scenario.
        with open(required_local_path, "w", encoding="utf-8") as dest_file:
            with open(user_defined_profile_datafile.local_path, "r", encoding="utf-8") as source_file:
                logger.info("What a horrible hack, FIXME")
                content = source_file.read()
                dest_file.write(content)

Current state

Please describe what you're doing presently to work around this or achieve what you're doing.

Proposed Solution

Please describe, if you can, how you think the feature should be implemented or problem solved

Supporting Octue

Octue is an Open-Source Software organisation helping you and many others to fight climate change. Providing support for your issues costs us c. 500GBP/day. Might your organisation be in a position to help sponsor this issue?

• We already are (eg via technical partnership or GitHub Sponsors )
• Yes (we'll prioritise this issue, and be in touch)
• No (we'll work on this issue as and when it aligns with our core development activity)