Task Description

Currently in HoodieSparkLanceWriter, our implementation for canWrite() defaults to the following

  public boolean canWrite() {
    //TODO will need to implement proper way to compute this
    return true;
  }

This task is to track a proper implementation that checks to see if the file has reached some threshold in size and if so should roll over the write to a new file

Task Type

Code improvement/refactoring

Related Issues

Parent feature issue: (if applicable )
Related issues:
NOTE: Use Relationships button to add parent/blocking issues after issue is created.