VTK8-Test-Failures

Revision as of 05:01, 10 April 2018 by MarkMiller (talk | contribs) (Databases - Mark)

Hybrid - Kathleen

Name Simple Rebaseline Notes
cinema-a.py Yes view/lighting
cinema-c.py (skipped)
cleanzonesonly.py No minor pixel diffs for plots, legend shifted slightly upwards. Should legends be removed from this test?
clonecopy.py (skipped)
clonefirstref.py Yes minor pixel diffs
conditional.py No some view/lighting, but also Interpolation:

conditional_04 conditional_05 conditional_06

conn_cmfe.py Yes view/lighting
coord_expr.py Yes view/lighting
curve_anim.py Yes view
curve_expressions.py No possible view clip issue with curve_exp_bin_02
cylindrical_radius.py Yes view/lighting
ddf.py No Interpolation ddf
defvar_anim.py Yes view/lighting
expr2engine.py Yes lighting
expr_cmfe.py Yes view/lighting
expressions.py Yes view/lighting
field_operators.py No Mostly view/lighting

Missing points

field_op_04

Inerpolation diffs

field_op_14 field_op_16 field_op_17 field_op_18

image_proc.py No Interpolation hybrid_image_proc
keyframe.py No view/lighting, but we should take a look at the strange highlighting of the endcaps on globe keyframe_43
lambda2.py Yes view/lighting
lineout.py (skipped)
locktime.py Yes minor pixel diffs
locus.py No could be just large quads split differently. look at locus_01
math_expr.py No quads split differently? see math_expr_02
matsel.py Yes view/lighting
matvf.py Yes view/lighting
merge_tree.py No Interpolation merge_tree
mesh_quality.py Yes view/lighting
mir.py Yes view/lighting
mir_cache.py Yes view/lighting
missingdata.py No Interpolation ? missingdata_0_01
movie.py (skipped)
multivar.py Yes view/lighting
pos_cmfe.py No Mostly view/lighting, except an Interpolation case pos_cmfe_01
py_exprs.py Yes minor pixel diffs
qcrit.py Yes view/lighting
replace.py No the surface is no longer smooth (curv3d.silo) see Replace3
selections.py (skipped)
selections_pp.py (skipped)
sil.py Yes view/lighting
simplify_mixed.py Yes view
specmf.py Yes minor pixel diffs
symm.py Yes view/lighting
time_cmfe.py Yes view/lighting
time_deriv_cmfe.py Yes view/lighting
time_iteration.py Yes view/lighting
timelock.py Yes view/lighting
val4mat.py Yes view

Plots - Eric

Name Simple Rebaseline Notes
surface.py Yes very small rendering changes, slight view change, line style not implemented
multicolor.py Yes very small rendering changes
contour.py Yes very small rendering changes, line style not implemented
mesh.py Yes very small rendering changes, line style not implemented
parcoords.py Yes label placement changed, should submit a ticket to improve
mesh_c.py Yes same as mesh
pseudocolor.py Yes very small rendering changes
vector.py Yes vector stems are not being shaded, should submit a ticket to fix
scatter.py Yes very small rendering changes
subset.py Yes very small rendering changes
volumePlot.py No one image of a slice is blank in current, another set of images are grayscale instead of color
ray_trace.py Yes very small rendering changes
tensor.py Yes very small rendering changes, one vector plot with vector stems not being shaded
truecolor.py Yes very small rendering changes
label.py No The text looks much better, but the size is different, the 2d text is smaller and the 3d text is larger, some non-visible labels showing in 3d
singlecolor.py Yes very small rendering changes
curve.py No curves getting cut off at bottom, some markers missing, markers are distorted, markers at too large, curve with single marker a diff color wrong, curves with line missing line, current curve scale blank - current not, quad splitting differences

Session - Kevin

Name Simple Rebaseline Notes
restorewithsources.py Yes very small pixel differences
textannot.py Yes view/positioning
correlationsession.py Yes minor pixel differences
selection.py Yes minor pixel differences
colortable.py Yes grid lines are a little thicker. view/positioning
view3d.py Yes minor pixel differences/positioning
legendproperties.py Yes minor pixel differences/positioning
rect3d-contour.py Yes minor pixel differences
wavecontour.py Yes minor pixel differences
simplekeyframe.py Yes better rendering of the grid
sessionview.py Yes better rendering of the grid/outline
sessionexpression.py Yes lighting

Simulation - Eric

Name Simple Rebaseline Notes
globalids.py Yes very small rendering changes
domainlist.py Yes very small rendering changes
polyhedral.py Yes very small rendering changes
updateplots.py Yes very small rendering changes
multiblock.py Yes very small rendering changes, slight 2d view change - should investigate
scalar.py Yes very small rendering changes, slight 2d view change, labels slightly larger
materialvar.py Yes very small rendering changes, slight 2d view change
unstructured.py Yes very small rendering changes
updateplots_session.py No very small rendering changes, triad line thickness wrong, title moved slightly
zerocopy.py Yes very small rendering changes
csg.py Yes very small rendering changes
amr.py Yes very small rendering changes, slight 2d view change
life.py Yes very small rendering changes
ucdcurve.py Yes very small rendering changes
batch.py No very small rendering changes, batch_06* images have a extra axis line on right side
domainbounds.py Yes very small rendering changes
curve.py Yes very small rendering changes
mandelbrot.py Yes very small rendering changes
var.py Yes very small rendering changes, slight 2d view change
point.py Yes very small rendering changes
aresamr.py Yes very small rendering changes
species.py Yes very small rendering changes
mesh.py No view change?, crash, need to investigate
material.py Yes very small rendering changes, slight 2d view change
interleave.py Yes very small rendering changes

Databases - Mark

The images for any <database>.py test python file not explicitly listed here is ok to entirely rebaseline all images from that file.

In a lot of cases in 2D plots especially, I noticed we dropped lines at the extreme edges of the plot. I think that is ok in some cases and NOT ok in other cases. I think if our orig. baselines had a different set of extreme edge lines missing and that situation just changed, that is probably ok. I think if the orig. baselines had all extreme edge lines correct and the new images are dropping some, that is a problem.

Name Notes
lata.py lata_03 seeing through mesh plot to zone face or face lighting is different, lata_07 missing >half of vector glyph tail, lata_12 odd shading
pdbdatabase.py pdb_multi_12 lighting or normals, pdb_multi_15 font size change in label plot
vtk.py vtk_01 good example of minor line change, vtk_16 view change, vtk_23 LQDS (large quad diagonal swap), vtk_37 shading or normals
silo.py silo_20 shading artifacts at domain boundaries or back faces showing through, silo_23 major change in y axis label position (other cases too), silo_91 funky shading issue along edges of large elements
samrai.py samrai_copper_matvf_02 great example of LQDS and bad choice, samrai_24 domain boundary line color thrashing, samrai_34 really bad and no ideas why
pixie.py pixie_07 really bad! distance between objects?
blueprint.py blueprint_2d_json_uniform_braid LQDS, blueprint_2d_hdf5_points_braid point glyph size change, blueprint_3d_hdf5_points_braid point glyph size change , blueprint_mfem_periodic_cube_json_sol LQDS
overlink.py overlink_02, overlink_03 & overlink_04 (probably other cases) shading or surface nomals issue
sami.py sami_05 shading or surface normal issue, mesh line positions relative to PC plot changed
netcdf.py netcdf_1_00 and other cases lost smooth shading of facets to flat shading
xmdf.py Xmdv_02 and other cases too label plot font size change
mfem.py input_mesh_disc-nurbs_mres_0000 improved, input_mesh_escher_mres_0000 single point artifacts, input_mesh_klein-donut_mres_0000, ex01_ex01-pipe-nurbs oddball shading, ex01_ex01-escher, input_mesh_pipe-nurbs_mres_0000, input_mesh_mobius-strip_mres_0000 seems like a sign. change in geometry (could be twisted hex)
exportdb.py export_db_3_00 shading artifacts at domain boundaries
global_node_ids global_node_ids10 shading change
mili.py mili_01 has zbuffer contention on different colored but same positioned plans
moab.py moab_02, zbuffer contention

Faulttolerance - Kevin

Name Simple Rebaseline Notes
badfile.py Yes Test Passed - Not images, text output
savewindow.py Yes Test Passed - Not images, text output

Queries - Matt

Name Simple Rebaseline Notes
hohlraum.py Yes lines are slightly off
length.py Yes lines are slightly off
avg_value.py Yes text and lines are slightly off
scf.py Yes text and lines are slightly off
conncomp.py Yes slight difference in the pixels
curvature.py Yes slight difference in the pixels
consistencyChecks.py Yes lines are slightly off. When only lines, % difference is ~50%. Could be difference line drawing algorithm
pickarray.py No There are new lines being drawn on these plots that do not exist in the baseline. I'm not sure about this
pick.py Maybe There are numerical differences in the output. If the view changed, then a different zone/node may have been picked. There are also big differences in the psuedocolor plot
queriesOverTime.py No most are minor differences in line drawing. AllTimeQueries_02, however is very different. This is a guess, but I think the new image is correct and the old image is an error.
line_scan.py Yes these are missing portions of lines
bestfitline.py Maybe seems like some are missing baseline images. Other than that, this looks like a rebaseline
pickNamedArgs.py Yes minor line diffs
scalabe2.py Maybe minor line diffs, but lots of lines. I think its ok but would like another set of eyes.

Rendering - Alister

Name Simple Rebaseline Notes
scalable2 No May just be a view change, but the colors are slightly different. Should probably review with group.
offscreen Yes Looks like a view change and different annotations placement.
saveformats Yes Exact match.
scalable_c No Failed exit. The ones that did run seem like a view change.
annotation No Most of the diffs just look like a view change and different annotation placement. Some of them (like annot2d_20), though, may have a difference in quad splitting. Should look more closely.
viewChange No Many of these look like annotation placement diffs, but some of the rendered datasets may have quad splitting differences.
legends No Most look like simple view changes and annotation diffs, but legends_7 is drastically different (volume rendering).
image No View shift and quad splitting?
axistitles No Significant difference in axis annotation position (0 - 5) and what looks like a simple view shift.
compositing No Very different shading.
bigdata Yes Looks like a view shift and possibly different lighting.
evalcubic Yes Looks like a simple view shift.
colortexture No Drastically different (case 0): looks like a quad splitting difference. There is also a lighting difference around edges (cases 1 - 4).
timeslider Yes Looks like a view shift.
lighting No The new version looks good but much brighter.
scalable No Failed exit. Those that ran look like a view shift.
volume No Very different results for 03 and 01 (possibly different rendering techniques used).
shadows Yes Looks like a view shift.
transparency Yes Looks like a view shift.
view No Most of the diffs look like a view shift. 24 and others have interesting line showing up (maybe lighting and view change?). 14 looks like a possible quad splitting difference.
text2d No Looks like a view shift and quad splitting difference.
pixeldata Yes Looks like a view shift.
text3d Yes Looks like a view shift.
renderpoints No All "check points drawn as spheres" are significantly different sizes. The rest appear to be view shifts.
line2d No Looks like a quad splitting difference.
line3d No Dot and dash lines are being used but rendered.
specular No Significant lighting differences. It looks fine but should be reviewed with group.

Operators - Cyrus

Name Simple Rebaseline Notes
ic_pics.py (skipped)
ex_surf.py Yes diffs look like view change
transform.py No view clip issue with one curve plot ops_transform08
lcs_ic_2.py Yes diffs look like view change
lcs.py No pseudocolor interp / rendering diffs
displace.py No pseudocolor interp / rendering diffs, see ops_disp02
elevate.py Yes diffs look like lighting changes (new images look better)
clip.py No clip fast looks different (could be better, but we need to look at it) clip_globe_fast
threeslice.py Yes diffs look like view or lighting change
onionpeel.py No diffs look like view or lighting change

labels look better, but we should review bigsil_mesh_01

amr_stitch.py Yes diffs look like view or lighting change
ic_integration.py (skipped)
slice.py No most diffs look like view or lighting change, but may be some clipping changes

Some may be better:

ops_Slice02

Some may be worse:

ops_Slice37 ops_Slice39

tube.py Yes diffs look like view or lighting change
ic_pathlines.py (skipped)
multires.py no diffs
ic_geometry.py (skipped)
lcs_operator.py (skipped)
persistent_particles.py No most diffs look like view or lighting change

points are smaller, which is probably fine -- but we should review as a team persistent_particles_03

indexselect.py Yes diffs look like view or lighting change
resample.py No interp differences operators_resample
inverse_ghost_zone.py No most diffs look like view or lighting change

missing lines: ops_inverse_ghost_zone05

lcs_lc_1.py Yes diffs look like view or lighting change
sph_resample.py Yes diffs look like view or lighting change
isovolume.py Yes diffs look like view or lighting change
defer_expr.py Yes diffs look like view or lighting change
cart_proj.py Yes diffs look like view or lighting change
reflect.py No most diffs look like view or lighting change

lighting diffs, probably ok but we should review as a team ops_refl06 ops_refl07 ops_refl08 ops_refl09

vol rendering diff ops_refl14

radial_resample.py Yes diffs look like view or lighting change
cracksclipper.py Yes diffs look like view or lighting change
box.py Yes diffs look like view or lighting change
threshold.py Yes diffs look like view or lighting change
explode.py Yes diffs look like view or lighting change
dual_mesh.py Yes diffs look like view or lighting change
lic_streamlines.py (skipped)
ic_termination.py Yes diffs look like view or lighting change
moveoperators.py Yes diffs look like view or lighting change

Meshtype - Kathleen

Name Simple Rebaseline Notes
arbpoly.py Yes view/lighting
csg.py Yes view/lighting
degen_mesh.py Yes view/lighting
emptydomains.py No Seems like view/lighting, but there appears to be highlighting along back edges of non-mesh plots:

emptydomains_02 emptydomains_03 emptydomains_04 emptydomains_07 emptydomains_10

globe.py No Mostly view/lighting, except Volume Rendering globe_04
point.py Yes view/lighting
rect3d.py No need another opinion, is this just view/lighting/opacity?

rect3d