Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Dec 3, 2016

• [SPARK-18690][PYTHON][SQL] Backward compatibility of unbounded frames

  Show description for a9cbfc4
  

  zero323

  authored and

  rxin

  committed
  a9cbfc4

  Copy full SHA for a9cbfc4

Commits on Dec 1, 2016

• [SPARK-18274][ML][PYSPARK] Memory leak in PySpark JavaWrapper

  Show description for 78bb7f8
  

  techaddict

  authored and

  jkbradley

  committed
  78bb7f8

  Copy full SHA for 78bb7f8

Commits on Nov 30, 2016

• [SPARK-18366][PYSPARK][ML] Add handleInvalid to Pyspark for QuantileDiscretizer and Bucketizer

  Show description for fe854f2
  

  techaddict

  authored and

  Nick Pentreath

  committed
  fe854f2

  Copy full SHA for fe854f2

• [SPARK-18516][STRUCTURED STREAMING] Follow up PR to add StreamingQuery.status to Python

  Show description for bc09a2b
  tdas

  committed
  bc09a2b

  Copy full SHA for bc09a2b

• [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of PySpark

  Show description for 4c82ca8
  

  zjffdu

  authored and

  yanboliang

  committed
  4c82ca8

  Copy full SHA for 4c82ca8

• [SPARK-18319][ML][QA2.1] 2.1 QA: API: Experimental, DeveloperApi, final, sealed audit

  Show description for 9b670bc
  

  YY-OnCall

  authored and

  jkbradley

  committed
  9b670bc

  Copy full SHA for 9b670bc

• [SPARK-18516][SQL] Split state and progress in streaming

  Show description for c3d08e2
  

  tdas

  authored and

  marmbrus

  committed
  c3d08e2

  Copy full SHA for c3d08e2

Commits on Nov 29, 2016

• [SPARK-18523][PYSPARK] Make SparkContext.stop more reliable

  Show description for 71352c9
  

  kxepal

  authored and

  rxin

  committed
  71352c9

  Copy full SHA for 71352c9

Commits on Nov 26, 2016

• [SPARK-18481][ML] ML 2.1 QA: Remove deprecated methods for ML

  Show description for c4a7eef
  yanboliang

  committed
  c4a7eef

  Copy full SHA for c4a7eef

Commits on Nov 22, 2016

• [SPARK-18447][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that` across Python API documentation

  Show description for 933a654
  

  HyukjinKwon

  authored and

  srowen

  committed
  933a654

  Copy full SHA for 933a654

• [SPARK-18493] Add missing python APIs: withWatermark and checkpoint to dataframe

  Show description for 97a8239
  

  brkyvz

  authored and

  zsxwing

  committed
  97a8239

  Copy full SHA for 97a8239

Commits on Nov 21, 2016

• [SPARK-18361][PYSPARK] Expose RDD localCheckpoint in PySpark

  Show description for 7017687
  

  Gabriel Huang

  authored and

  andrewor14

  committed
  7017687

  Copy full SHA for 7017687

• [SPARK-18282][ML][PYSPARK] Add python clustering summaries for GMM and BKM

  Show description for e811fbf
  

  sethah

  authored and

  yanboliang

  committed
  e811fbf

  Copy full SHA for e811fbf

Commits on Nov 19, 2016

• [SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that`/`'''Note:'''` across Scala/Java API documentation

  Show description for d5b1d5f
  

  HyukjinKwon

  authored and

  srowen

  committed
  d5b1d5f

  Copy full SHA for d5b1d5f

Commits on Nov 17, 2016

• [SPARK-18365][DOCS] Improve Sample Method Documentation

  Show description for 49b6f45
  

  bllchmbrs

  authored and

  srowen

  committed
  49b6f45

  Copy full SHA for 49b6f45

Commits on Nov 16, 2016

• [SPARK-1267][SPARK-18129] Allow PySpark to be pip installed

  Show description for a36a76a
  

  holdenk

  authored and

  JoshRosen

  committed
  a36a76a

  Copy full SHA for a36a76a

• [SPARK-18459][SPARK-18460][STRUCTUREDSTREAMING] Rename triggerId to batchId and add triggerDetails to json in StreamingQueryStatus

  Show description for 0048ce7
  

  tdas

  authored and

  zsxwing

  committed
  0048ce7

  Copy full SHA for 0048ce7

Commits on Nov 10, 2016

• [MINOR][PYSPARK] Improve error message when running PySpark with different minor versions

  Show description for cc86fcd
  

  viirya

  authored and

  srowen

  committed
  cc86fcd

  Copy full SHA for cc86fcd

Commits on Nov 9, 2016

• [SPARK-17829][SQL] Stable format for offset log

  Show description for 3f62e1b
  

  Tyson Condie

  authored and

  zsxwing

  committed
  3f62e1b

  Copy full SHA for 3f62e1b

• [SPARK-18239][SPARKR] Gradient Boosted Tree for R

  Show description for 55964c1
  

  felixcheung

  authored and

  Felix Cheung

  committed
  55964c1

  Copy full SHA for 55964c1

Commits on Nov 6, 2016

• [MINOR][DOCUMENTATION] Fix some minor descriptions in functions consistently with expressions

  Show description for 15d3926
  

  HyukjinKwon

  authored and

  Felix Cheung

  committed
  15d3926

  Copy full SHA for 15d3926

Commits on Nov 4, 2016

• [SPARK-14393][SQL][DOC] update doc for python and R

  Show description for a08463b
  

  felixcheung

  authored and

  Felix Cheung

  committed
  a08463b

  Copy full SHA for a08463b

• [SPARK-18138][DOCS] Document that Java 7, Python 2.6, Scala 2.10, Hadoop < 2.6 are deprecated in Spark 2.1.0

  Show description for dc4c600
  

  srowen

  authored and

  rxin

  committed
  dc4c600

  Copy full SHA for dc4c600

Commits on Nov 3, 2016

• [SPARK-18177][ML][PYSPARK] Add missing 'subsamplingRate' of pyspark GBTClassifier

  Show description for 9dc9f9a
  

  zhengruifeng

  authored and

  yanboliang

  committed
  9dc9f9a

  Copy full SHA for 9dc9f9a

Commits on Nov 2, 2016

• [SPARK-18088][ML] Various ChiSqSelector cleanups

  Show description for 91c33a0
  jkbradley

  committed
  91c33a0

  Copy full SHA for 91c33a0

Commits on Nov 1, 2016

• [SPARK-17764][SQL] Add `to_json` supporting to convert nested struct column to JSON string

  Show description for 01dd008
  

  HyukjinKwon

  authored and

  marmbrus

  committed
  01dd008

  Copy full SHA for 01dd008

Commits on Oct 30, 2016

• [SPARK-18110][PYTHON][ML] add missing parameter in Python for RandomForest regression and classification

  Show description for 7c37869
  

  felixcheung

  authored and

  Felix Cheung

  committed
  7c37869

  Copy full SHA for 7c37869

Commits on Oct 27, 2016

• [SPARK-17219][ML] enhanced NaN value handling in Bucketizer

  Show description for 0b076d4
  

  VinceShieh

  authored and

  jkbradley

  committed
  0b076d4

  Copy full SHA for 0b076d4

• [SQL][DOC] updating doc for JSON source to link to jsonlines.org

  Show description for 44c8bfd
  

  felixcheung

  authored and

  Felix Cheung

  committed
  44c8bfd

  Copy full SHA for 44c8bfd

Commits on Oct 21, 2016

• [SPARK-17926][SQL][STREAMING] Added json for statuses

  Show description for 7a531e3
  

  tdas

  authored and

  yhuai

  committed
  7a531e3

  Copy full SHA for 7a531e3

• [SPARK-17960][PYSPARK][UPGRADE TO PY4J 0.10.4]

  Show description for 595893d
  

  jagadeesanas2

  authored and

  srowen

  committed
  595893d

  Copy full SHA for 595893d

Commits on Oct 18, 2016

• [SPARK-17817] [PYSPARK] [FOLLOWUP] PySpark RDD Repartitioning Results in Highly Skewed Partition Sizes

  Show description for 1e35e96
  

  viirya

  authored and

  davies

  committed
  1e35e96

  Copy full SHA for 1e35e96

Commits on Oct 15, 2016

• [SPARK-17946][PYSPARK] Python crossJoin API similar to Scala

  Show description for 2d96d35
  

  srinathshankar

  authored and

  rxin

  committed
  2d96d35

  Copy full SHA for 2d96d35

Commits on Oct 14, 2016

• [SPARK-11775][PYSPARK][SQL] Allow PySpark to register Java UDF

  Show description for f00df40
  

  zjffdu

  authored and

  marmbrus

  committed
  f00df40

  Copy full SHA for f00df40

• [SPARK-16063][SQL] Add storageLevel to Dataset

  Show description for 5aeb738
  

  Nick Pentreath

  authored and

  marmbrus

  committed
  5aeb738

  Copy full SHA for 5aeb738