class EdgeReader extends AnyRef
Reader for edge chunks.
- Alphabetic
- By Inheritance
- EdgeReader
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
-
new
EdgeReader(prefix: String, edgeInfo: EdgeInfo, adjListType: AdjListType.Value, spark: SparkSession)
create a new edge reader with edge info and AdjList type.
create a new edge reader with edge info and AdjList type.
- prefix
the absolute prefix.
- edgeInfo
the edge info that describes the edge type.
- adjListType
the adj list type for the edge.
- spark
spark session for the reader to read chunks as Spark DataFrame. Note that constructor would raise IllegalArgumentException if edge info does not support given adjListType.
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native() @HotSpotIntrinsicCandidate()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native() @HotSpotIntrinsicCandidate()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native() @HotSpotIntrinsicCandidate()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native() @HotSpotIntrinsicCandidate()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native() @HotSpotIntrinsicCandidate()
-
def
readAdjListChunk(vertex_chunk_index: Long, chunk_index: Long): DataFrame
Load a single AdjList chunk as a DataFrame.
Load a single AdjList chunk as a DataFrame.
- vertex_chunk_index
index of vertex chunk
- chunk_index
index of AdjList chunk.
- returns
AdjList chunk DataFrame
-
def
readAdjListForVertexChunk(vertex_chunk_index: Long, addIndex: Boolean = true): DataFrame
Load all AdjList chunks for a vertex chunk as a DataFrame.
Load all AdjList chunks for a vertex chunk as a DataFrame.
- vertex_chunk_index
index of vertex chunk.
- addIndex
flag that add edge index column or not in the final DataFrame.
- returns
DataFrame of all AdjList chunks of vertices in given vertex chunk.
-
def
readAllAdjList(addIndex: Boolean = true): DataFrame
Load all AdjList chunks for this edge type as a DataFrame.
Load all AdjList chunks for this edge type as a DataFrame.
- addIndex
flag that add index column or not in the final DataFrame.
- returns
DataFrame of all AdjList chunks.
-
def
readAllEdgePropertyGroups(addIndex: Boolean = true): DataFrame
Load the chunks for all property groups as a DataFrame.
Load the chunks for all property groups as a DataFrame.
- addIndex
flag that add edge index column or not in the final DataFrame.
- returns
DataFrame tha contains all property groups chunks of edge.
-
def
readAllEdgePropertyGroupsForVertexChunk(vertex_chunk_index: Long, addIndex: Boolean = true): DataFrame
Load the chunks for all property groups of a vertex chunk as a DataFrame.
Load the chunks for all property groups of a vertex chunk as a DataFrame.
- vertex_chunk_index
index of vertex chunk.
- addIndex
flag that add edge index column or not in the final DataFrame.
- returns
DataFrame that contains all property groups chunks of a vertex chunk.
-
def
readEdgePropertyChunk(propertyGroup: PropertyGroup, vertex_chunk_index: Long, chunk_index: Long): DataFrame
Load a single edge property chunk as a DataFrame.
Load a single edge property chunk as a DataFrame.
- propertyGroup
property group.
- vertex_chunk_index
index of vertex chunk.
- chunk_index
index of property group chunk.
- returns
property group chunk DataFrame. If edge info does not contain the property group, raise an IllegalArgumentException error.
-
def
readEdgePropertyGroup(propertyGroup: PropertyGroup, addIndex: Boolean = true): DataFrame
Load all chunks for a property group as a DataFrame.
Load all chunks for a property group as a DataFrame.
- propertyGroup
property group.
- addIndex
flag that add edge index column or not in the final DataFrame.
- returns
DataFrame that contains all chunks of property group. If edge info does not contain the property group, raise an IllegalArgumentException error.
-
def
readEdgePropertyGroupForVertexChunk(propertyGroup: PropertyGroup, vertex_chunk_index: Long, addIndex: Boolean = true): DataFrame
Load the chunks for a property group of a vertex chunk as a DataFrame.
Load the chunks for a property group of a vertex chunk as a DataFrame.
- propertyGroup
property group.
- vertex_chunk_index
index of vertex chunk.
- addIndex
flag that add edge index column or not in the final DataFrame.
- returns
DataFrame that contains all property group chunks of vertices in given vertex chunk. If edge info does not contain the property group, raise an IllegalArgumentException error.
-
def
readEdges(addIndex: Boolean = true): DataFrame
Load the chunks for the AdjList and all property groups as a DataFrame.
Load the chunks for the AdjList and all property groups as a DataFrame.
- addIndex
flag that add edge index column or not in the final DataFrame.
- returns
DataFrame that contains all chunks of AdjList and property groups of edge.
-
def
readEdgesForVertexChunk(vertex_chunk_index: Long, addIndex: Boolean = true): DataFrame
Load the chunks for the AdjList and all property groups for a vertex chunk as a DataFrame.
Load the chunks for the AdjList and all property groups for a vertex chunk as a DataFrame.
- vertex_chunk_index
index of vertex chunk
- addIndex
flag that add edge index column or not in the final DataFrame.
- returns
DataFrame that contains all chunks of AdjList and property groups of vertices in given vertex chunk.
-
def
readEdgesNumber(): Long
Load the total number of edges for this edge type.
-
def
readEdgesNumber(chunk_index: Long): Long
Load the number of edges for the vertex chunk.
Load the number of edges for the vertex chunk.
- chunk_index
index of vertex chunk
- returns
the number of edges
-
def
readMultipleEdgePropertyGroups(propertyGroups: ArrayList[PropertyGroup], addIndex: Boolean = true): DataFrame
Load the chunks for multiple property groups as a DataFrame.
Load the chunks for multiple property groups as a DataFrame.
- propertyGroups
list of property groups.
- addIndex
flag that add edge index column or not in the final DataFrame.
- returns
DataFrame tha contains all property groups chunks of edge.
-
def
readMultipleEdgePropertyGroupsForVertexChunk(propertyGroups: ArrayList[PropertyGroup], vertex_chunk_index: Long, addIndex: Boolean = true): DataFrame
Load the chunks for multiple property groups of a vertex chunk as a DataFrame.
Load the chunks for multiple property groups of a vertex chunk as a DataFrame.
- propertyGroups
list of property groups.
- vertex_chunk_index
index of vertex chunk.
- addIndex
flag that add edge index column or not in the final DataFrame.
- returns
DataFrame that contains all property groups chunks of a vertex chunk.
-
def
readOffset(chunk_index: Long): DataFrame
Load a single offset chunk as a DataFrame.
Load a single offset chunk as a DataFrame.
- chunk_index
index of offset chunk
- returns
offset chunk DataFrame. Raise IllegalArgumentException if adjListType is not AdjListType.ordered_by_source or AdjListType.ordered_by_dest.
-
def
readVertexChunkNumber(): Long
Load the chunk number of src/dst vertices.
-
def
readVerticesNumber(): Long
Load the total number of src/dst vertices for this edge type.
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
Deprecated Value Members
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] ) @Deprecated
- Deprecated