Remove upper-bound pin on pyarrow

[dhirschfeld]

Resolves #13
Closes #17

[dhirschfeld]

ping @jprakash-db, @yinouya-db, @jackyhu-db, @benc-db, @gopalldb 🙏

[dhirschfeld]

Bump!

[dhirschfeld]

Could someone please approve the workflows?

[boyeah]

I would like this as well, but suggest to remove the dependency on pyarrow altogether. As far as I can see, pyarrow is not used at all by this library.

[dhirschfeld]

I would like this as well, but suggest to remove the dependency on pyarrow altogether. As far as I can see, pyarrow is not used at all by this library.

Hmm, yeah - good catch. I've asked @jprakash-db why it has been added if it's not being used directly:

• Bump upto version 2.0.3 #7 (comment)

[jtmcn]

Can this please be merged? It seems @jprakash-db has not responded to why the pin was added in the first place despite the package being unused. Meanwhile it is forcing Databricks customers to remain stuck on a version of pyarrow with a known critical vulnerability

[jprakash-db]

@jtmcn Didn't have time to look at it. Will just have a few checks done and update the status to merge. Will update the status this week. cc @deeksha-db

[jtmcn]

@jprakash-db any updates? Or @benc-db can this be merged please?

[ruiyang2015]

also need this, please prioritize this PR thanks.