Workflows, Data Lake/Warehouse Tod Olson (17 Jul 2018 16:01 EDT)
Re: Workflows, Data Lake/Warehouse Mark Veksler (17 Jul 2018 17:24 EDT)

Re: Workflows, Data Lake/Warehouse Mark Veksler 17 Jul 2018 17:24 EDT

Cool!  Not sure how accurate it is but I thought I heard there were some restrictions as to what type of work the Mellon-funded developers can be applied to.

I also heard that there was interest from UPenn to build out their implementation of a data lake/warehouse -- which could probably be also used to set up a reference implementation of a data lake/warehouse.
Vince's RFC covers data capture/storage within FOLIO, so for their work to set up a data lake/warehouse, they'd 'only' need to set up a pipe from FOLIO into their data lake/warehouse.

On 7/17/18, 4:02 PM, "tech-council@ole-lists.openlibraryfoundation.org on behalf of Tod Olson" <tech-council@ole-lists.openlibraryfoundation.org on behalf of tod@uchicago.edu> wrote:

    CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.

    TC,

    We have something on the Data Lake/Data Warehouse in our backlog. I believe we will also be asked to look at the workflow engine in conjunction with the Product Council.

    We're not in the resourcing business, but I should mention that the OLE project has a couple Mellon-funded developers for a limited length of time. There are constraints on where we can assign those devs, but we think we could assign one to each of those areas if teams were to be spun up.

    -Tod

    To unsubscribe from this list please go to http://www.simplelists.com/confirm.php?u=Vy4UmbCQg2YUuehuMGk9b9LQwA9fx5Pb