Discussions

• 1 You must be logged in to vote

  🙏

  How to download a dataset from HuggingFace (for example cais / mmlu)

  touma-I asked Oct 15, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Fuzzy Dedupe fail

  CaiYiGitHub asked Jul 1, 2025 in Q&A · Unanswered

  

  

  1
• 0 You must be logged in to vote

  🙏

  How to contribute to a tekton pipeline feature branch

  touma-I asked Sep 24, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Installation failure of individual transform on Red Hat machine

  revit13 asked Sep 1, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  How to tag the maintainers in your comment or question

  touma-I started Jul 11, 2025 in General

  

  

  0
• 2 You must be logged in to vote

  🙏

  how to set dpk_connector debug level

  sujee asked Apr 25, 2025 in Q&A · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  Code2Parquet Supported Langs

  JacobKohav asked Apr 18, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  Rebuilding the Ray version of data-processing-lib and transforms with an alternative to Ray

  ritvikrao started Feb 7, 2025 in General

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  How to download a single parquet file from HuggingFace for use in your recipe ?

  touma-I asked Jan 30, 2025 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Running Transforms 1.0.0 on Windows

  touma-I asked Jan 24, 2025 in Q&A · Unanswered

  

  

  5
• 1 You must be logged in to vote

  💬

  Cons and Pros compared to data-juicer

  vincent-pli started Nov 26, 2024 in General

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  when adopt remote ray cluster, how the rayWorker read the local files

  vincent-pli asked Nov 26, 2024 in Q&A · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  💬

  Feedback from DPK + RAG workshop from NumHack hackathon (2024-11-14)

  sujee started Nov 14, 2024 in General

  

  

  

  

  5
• 1 You must be logged in to vote

  💬

  Feedback from DPK workshop @ Llama impact hackathon

  sujee started Nov 12, 2024 in General

  

  

  

  

  8
• 1 You must be logged in to vote

  🙏

  How to pip install ray or spark extra using a Git URL ?

  touma-I asked Oct 24, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  tutorials

  sujee started Oct 31, 2024 in Ideas

  

  

  1
• 2 You must be logged in to vote

  💬

  Notes from Data Prep Kit workshop at IBM techXchange conference in Las Vegas (Oct 21, 2024)

  sujee started Oct 30, 2024 in General

  

  

  1